2023-11-21 13:53:18,176 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-21 13:53:18,419 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2 2023-11-21 13:53:18,435 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-21 13:53:18,435 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/cluster_95986160-9be6-b7e5-6f91-17727d35080f, deleteOnExit=true 2023-11-21 13:53:18,436 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-21 13:53:18,436 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/test.cache.data in system properties and HBase conf 2023-11-21 13:53:18,437 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/hadoop.tmp.dir in system properties and HBase conf 2023-11-21 13:53:18,437 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/hadoop.log.dir in system properties and HBase conf 2023-11-21 13:53:18,438 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-21 13:53:18,438 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-21 13:53:18,438 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-21 13:53:18,562 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-21 13:53:18,966 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-21 13:53:18,971 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-21 13:53:18,971 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-21 13:53:18,972 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-21 13:53:18,972 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-21 13:53:18,973 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-21 13:53:18,973 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-21 13:53:18,973 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-21 13:53:18,973 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-21 13:53:18,974 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-21 13:53:18,974 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/nfs.dump.dir in system properties and HBase conf 2023-11-21 13:53:18,974 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/java.io.tmpdir in system properties and HBase conf 2023-11-21 13:53:18,975 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-21 13:53:18,975 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-21 13:53:18,975 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-21 13:53:19,630 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-21 13:53:19,635 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-21 13:53:19,957 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-21 13:53:20,140 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-21 13:53:20,164 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-21 13:53:20,205 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-21 13:53:20,238 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/java.io.tmpdir/Jetty_localhost_43083_hdfs____6barqu/webapp 2023-11-21 13:53:20,390 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43083 2023-11-21 13:53:20,400 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-21 13:53:20,401 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-21 13:53:20,937 WARN [Listener at localhost/40667] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-21 13:53:21,031 WARN [Listener at localhost/40667] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-21 13:53:21,058 WARN [Listener at localhost/40667] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-21 13:53:21,065 INFO [Listener at localhost/40667] log.Slf4jLog(67): jetty-6.1.26 2023-11-21 13:53:21,072 INFO [Listener at localhost/40667] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/java.io.tmpdir/Jetty_localhost_35959_datanode____gf9lr6/webapp 2023-11-21 13:53:21,184 INFO [Listener at localhost/40667] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35959 2023-11-21 13:53:21,556 WARN [Listener at localhost/35077] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-21 13:53:22,097 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x371f8e2e833102f1: Processing first storage report for DS-ad5d9bc3-3914-425d-a316-f0a87e8723e3 from datanode b16c3264-e603-4ce1-936d-0d9ee4193789 2023-11-21 13:53:22,099 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x371f8e2e833102f1: from storage DS-ad5d9bc3-3914-425d-a316-f0a87e8723e3 node DatanodeRegistration(127.0.0.1:45515, datanodeUuid=b16c3264-e603-4ce1-936d-0d9ee4193789, infoPort=41519, infoSecurePort=0, ipcPort=35077, storageInfo=lv=-57;cid=testClusterID;nsid=1560434443;c=1700574799715), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-11-21 13:53:22,099 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x371f8e2e833102f1: Processing first storage report for DS-36273118-53eb-42e9-a41f-0a46ccf4ede7 from datanode b16c3264-e603-4ce1-936d-0d9ee4193789 2023-11-21 13:53:22,100 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x371f8e2e833102f1: from storage DS-36273118-53eb-42e9-a41f-0a46ccf4ede7 node DatanodeRegistration(127.0.0.1:45515, datanodeUuid=b16c3264-e603-4ce1-936d-0d9ee4193789, infoPort=41519, infoSecurePort=0, ipcPort=35077, storageInfo=lv=-57;cid=testClusterID;nsid=1560434443;c=1700574799715), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-11-21 13:53:22,187 DEBUG [Listener at localhost/35077] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2 2023-11-21 13:53:22,314 INFO [Listener at localhost/35077] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/cluster_95986160-9be6-b7e5-6f91-17727d35080f/zookeeper_0, clientPort=52369, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/cluster_95986160-9be6-b7e5-6f91-17727d35080f/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/cluster_95986160-9be6-b7e5-6f91-17727d35080f/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-21 13:53:22,332 INFO [Listener at localhost/35077] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52369 2023-11-21 13:53:22,343 INFO [Listener at localhost/35077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-21 13:53:22,346 INFO [Listener at localhost/35077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-21 13:53:23,046 INFO [Listener at localhost/35077] util.FSUtils(471): Created version file at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4 with version=8 2023-11-21 13:53:23,046 INFO [Listener at localhost/35077] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/hbase-staging 2023-11-21 13:53:23,357 INFO [Listener at localhost/35077] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-21 13:53:23,842 INFO [Listener at localhost/35077] client.ConnectionUtils(127): master/jenkins-hbase6:0 server-side Connection retries=3 2023-11-21 13:53:23,879 INFO [Listener at localhost/35077] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-21 13:53:23,880 INFO [Listener at localhost/35077] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-21 13:53:23,880 INFO [Listener at localhost/35077] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-21 13:53:23,880 INFO [Listener at localhost/35077] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-21 13:53:23,881 INFO [Listener at localhost/35077] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-21 13:53:24,036 INFO [Listener at localhost/35077] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-21 13:53:24,107 DEBUG [Listener at localhost/35077] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-21 13:53:24,202 INFO [Listener at localhost/35077] ipc.NettyRpcServer(120): Bind to /172.31.2.20:43219 2023-11-21 13:53:24,212 INFO [Listener at localhost/35077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-21 13:53:24,214 INFO [Listener at localhost/35077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-21 13:53:24,239 INFO [Listener at localhost/35077] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43219 connecting to ZooKeeper ensemble=127.0.0.1:52369 2023-11-21 13:53:24,284 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:432190x0, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-21 13:53:24,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:43219-0x101309c3dab0000 connected 2023-11-21 13:53:24,319 DEBUG [Listener at localhost/35077] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-21 13:53:24,320 DEBUG [Listener at localhost/35077] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-21 13:53:24,323 DEBUG [Listener at localhost/35077] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-21 13:53:24,331 DEBUG [Listener at localhost/35077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43219 2023-11-21 13:53:24,334 DEBUG [Listener at localhost/35077] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43219 2023-11-21 13:53:24,335 DEBUG [Listener at localhost/35077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43219 2023-11-21 13:53:24,335 DEBUG [Listener at localhost/35077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43219 2023-11-21 13:53:24,336 DEBUG [Listener at localhost/35077] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43219 2023-11-21 13:53:24,341 INFO [Listener at localhost/35077] master.HMaster(444): hbase.rootdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4, hbase.cluster.distributed=false 2023-11-21 13:53:24,409 INFO [Listener at localhost/35077] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=3 2023-11-21 13:53:24,409 INFO [Listener at localhost/35077] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-21 13:53:24,409 INFO [Listener at localhost/35077] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-21 13:53:24,409 INFO [Listener at localhost/35077] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-21 13:53:24,410 INFO [Listener at localhost/35077] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-21 13:53:24,410 INFO [Listener at localhost/35077] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-21 13:53:24,414 INFO [Listener at localhost/35077] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-21 13:53:24,417 INFO [Listener at localhost/35077] ipc.NettyRpcServer(120): Bind to /172.31.2.20:46365 2023-11-21 13:53:24,419 INFO [Listener at localhost/35077] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-21 13:53:24,425 DEBUG [Listener at localhost/35077] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-21 13:53:24,426 INFO [Listener at localhost/35077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-21 13:53:24,429 INFO [Listener at localhost/35077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-21 13:53:24,431 INFO [Listener at localhost/35077] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46365 connecting to ZooKeeper ensemble=127.0.0.1:52369 2023-11-21 13:53:24,435 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:463650x0, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-21 13:53:24,436 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46365-0x101309c3dab0001 connected 2023-11-21 13:53:24,436 DEBUG [Listener at localhost/35077] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-21 13:53:24,437 DEBUG [Listener at localhost/35077] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-21 13:53:24,438 DEBUG [Listener at localhost/35077] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-21 13:53:24,439 DEBUG [Listener at localhost/35077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46365 2023-11-21 13:53:24,439 DEBUG [Listener at localhost/35077] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46365 2023-11-21 13:53:24,440 DEBUG [Listener at localhost/35077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46365 2023-11-21 13:53:24,440 DEBUG [Listener at localhost/35077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46365 2023-11-21 13:53:24,442 DEBUG [Listener at localhost/35077] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46365 2023-11-21 13:53:24,444 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase6.apache.org,43219,1700574803183 2023-11-21 13:53:24,453 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-21 13:53:24,456 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase6.apache.org,43219,1700574803183 2023-11-21 13:53:24,477 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-21 13:53:24,477 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-21 13:53:24,477 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-21 13:53:24,479 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-21 13:53:24,480 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase6.apache.org,43219,1700574803183 from backup master directory 2023-11-21 13:53:24,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-21 13:53:24,483 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase6.apache.org,43219,1700574803183 2023-11-21 13:53:24,483 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-21 13:53:24,484 WARN [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-21 13:53:24,484 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase6.apache.org,43219,1700574803183 2023-11-21 13:53:24,488 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-21 13:53:24,489 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-21 13:53:24,573 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/hbase.id with ID: 3a1875df-d5da-462c-bf2f-a3b54c1c9c77 2023-11-21 13:53:24,615 INFO [master/jenkins-hbase6:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-21 13:53:24,631 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-21 13:53:24,676 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x11b841bd to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:53:24,710 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59800121, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:53:24,735 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-21 13:53:24,737 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-21 13:53:24,754 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-21 13:53:24,754 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-21 13:53:24,756 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-21 13:53:24,761 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-21 13:53:24,762 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-21 13:53:24,797 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/MasterData/data/master/store-tmp 2023-11-21 13:53:24,826 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:53:24,826 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-21 13:53:24,826 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-21 13:53:24,826 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-21 13:53:24,826 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-21 13:53:24,826 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-21 13:53:24,826 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-21 13:53:24,826 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-21 13:53:24,828 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/MasterData/WALs/jenkins-hbase6.apache.org,43219,1700574803183 2023-11-21 13:53:24,847 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C43219%2C1700574803183, suffix=, logDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/MasterData/WALs/jenkins-hbase6.apache.org,43219,1700574803183, archiveDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/MasterData/oldWALs, maxLogs=10 2023-11-21 13:53:24,921 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45515,DS-ad5d9bc3-3914-425d-a316-f0a87e8723e3,DISK] 2023-11-21 13:53:24,930 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-21 13:53:25,001 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/MasterData/WALs/jenkins-hbase6.apache.org,43219,1700574803183/jenkins-hbase6.apache.org%2C43219%2C1700574803183.1700574804857 2023-11-21 13:53:25,002 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45515,DS-ad5d9bc3-3914-425d-a316-f0a87e8723e3,DISK]] 2023-11-21 13:53:25,002 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-21 13:53:25,003 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:53:25,006 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-21 13:53:25,008 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-21 13:53:25,078 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-21 13:53:25,085 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-21 13:53:25,108 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-21 13:53:25,119 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:53:25,126 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-21 13:53:25,128 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-21 13:53:25,146 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-21 13:53:25,151 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:53:25,152 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61443282, jitterRate=-0.08442375063896179}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-21 13:53:25,152 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-21 13:53:25,155 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-21 13:53:25,174 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-21 13:53:25,174 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-21 13:53:25,176 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-21 13:53:25,178 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-11-21 13:53:25,211 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 32 msec 2023-11-21 13:53:25,211 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-21 13:53:25,237 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-21 13:53:25,243 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-21 13:53:25,270 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-21 13:53:25,273 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-21 13:53:25,276 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-21 13:53:25,281 INFO [master/jenkins-hbase6:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-21 13:53:25,285 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-21 13:53:25,289 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-21 13:53:25,290 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-21 13:53:25,291 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-21 13:53:25,305 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-21 13:53:25,312 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-21 13:53:25,312 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-21 13:53:25,312 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-21 13:53:25,313 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase6.apache.org,43219,1700574803183, sessionid=0x101309c3dab0000, setting cluster-up flag (Was=false) 2023-11-21 13:53:25,332 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-21 13:53:25,340 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-21 13:53:25,343 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,43219,1700574803183 2023-11-21 13:53:25,348 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-21 13:53:25,355 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-21 13:53:25,356 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,43219,1700574803183 2023-11-21 13:53:25,359 WARN [master/jenkins-hbase6:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.hbase-snapshot/.tmp 2023-11-21 13:53:25,447 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(951): ClusterId : 3a1875df-d5da-462c-bf2f-a3b54c1c9c77 2023-11-21 13:53:25,452 DEBUG [RS:0;jenkins-hbase6:46365] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-21 13:53:25,462 DEBUG [RS:0;jenkins-hbase6:46365] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-21 13:53:25,462 DEBUG [RS:0;jenkins-hbase6:46365] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-21 13:53:25,466 DEBUG [RS:0;jenkins-hbase6:46365] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-21 13:53:25,469 DEBUG [RS:0;jenkins-hbase6:46365] zookeeper.ReadOnlyZKClient(139): Connect 0x33b88935 to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:53:25,475 DEBUG [RS:0;jenkins-hbase6:46365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d7f7132, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:53:25,475 DEBUG [RS:0;jenkins-hbase6:46365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3940e245, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-11-21 13:53:25,491 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-21 13:53:25,502 DEBUG [RS:0;jenkins-hbase6:46365] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase6:46365 2023-11-21 13:53:25,503 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-11-21 13:53:25,503 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-11-21 13:53:25,503 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-11-21 13:53:25,503 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-11-21 13:53:25,503 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase6:0, corePoolSize=10, maxPoolSize=10 2023-11-21 13:53:25,503 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-11-21 13:53:25,503 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-11-21 13:53:25,504 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-11-21 13:53:25,505 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1700574835505 2023-11-21 13:53:25,508 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-21 13:53:25,508 INFO [RS:0;jenkins-hbase6:46365] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-21 13:53:25,508 INFO [RS:0;jenkins-hbase6:46365] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-21 13:53:25,508 DEBUG [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1022): About to register with Master. 2023-11-21 13:53:25,511 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase6.apache.org,43219,1700574803183 with isa=jenkins-hbase6.apache.org/172.31.2.20:46365, startcode=1700574804408 2023-11-21 13:53:25,511 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-21 13:53:25,512 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-21 13:53:25,517 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-21 13:53:25,520 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-21 13:53:25,527 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-21 13:53:25,527 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-21 13:53:25,527 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-21 13:53:25,527 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-21 13:53:25,529 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-21 13:53:25,529 DEBUG [RS:0;jenkins-hbase6:46365] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-21 13:53:25,531 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-21 13:53:25,533 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-21 13:53:25,533 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-21 13:53:25,535 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-21 13:53:25,536 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-21 13:53:25,537 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1700574805537,5,FailOnTimeoutGroup] 2023-11-21 13:53:25,538 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1700574805537,5,FailOnTimeoutGroup] 2023-11-21 13:53:25,538 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-21 13:53:25,538 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-21 13:53:25,539 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-21 13:53:25,539 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-21 13:53:25,550 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-21 13:53:25,552 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-21 13:53:25,552 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4 2023-11-21 13:53:25,567 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:53:25,571 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-21 13:53:25,574 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/info 2023-11-21 13:53:25,576 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-21 13:53:25,577 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:53:25,578 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-21 13:53:25,581 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/rep_barrier 2023-11-21 13:53:25,582 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-21 13:53:25,583 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:53:25,584 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-21 13:53:25,586 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/table 2023-11-21 13:53:25,587 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-21 13:53:25,587 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:53:25,589 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740 2023-11-21 13:53:25,590 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:53589, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-21 13:53:25,590 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740 2023-11-21 13:53:25,595 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-21 13:53:25,597 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-21 13:53:25,601 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:53:25,603 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69015100, jitterRate=0.02840512990951538}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-21 13:53:25,603 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-21 13:53:25,603 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43219] master.ServerManager(388): Registering regionserver=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:25,603 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-21 13:53:25,603 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-21 13:53:25,604 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-21 13:53:25,604 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-21 13:53:25,604 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-21 13:53:25,605 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-21 13:53:25,605 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-21 13:53:25,611 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-21 13:53:25,611 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-21 13:53:25,622 DEBUG [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4 2023-11-21 13:53:25,622 DEBUG [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40667 2023-11-21 13:53:25,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-21 13:53:25,622 DEBUG [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-11-21 13:53:25,629 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-21 13:53:25,629 DEBUG [RS:0;jenkins-hbase6:46365] zookeeper.ZKUtil(162): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:25,630 WARN [RS:0;jenkins-hbase6:46365] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-21 13:53:25,630 INFO [RS:0;jenkins-hbase6:46365] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-21 13:53:25,631 DEBUG [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/WALs/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:25,631 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,46365,1700574804408] 2023-11-21 13:53:25,636 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-21 13:53:25,640 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-21 13:53:25,641 DEBUG [RS:0;jenkins-hbase6:46365] zookeeper.ZKUtil(162): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:25,653 DEBUG [RS:0;jenkins-hbase6:46365] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-21 13:53:25,661 INFO [RS:0;jenkins-hbase6:46365] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-21 13:53:25,680 INFO [RS:0;jenkins-hbase6:46365] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-21 13:53:25,683 INFO [RS:0;jenkins-hbase6:46365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:53:25,684 INFO [RS:0;jenkins-hbase6:46365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:53:25,685 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-11-21 13:53:25,692 INFO [RS:0;jenkins-hbase6:46365] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-21 13:53:25,692 DEBUG [RS:0;jenkins-hbase6:46365] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-11-21 13:53:25,693 DEBUG [RS:0;jenkins-hbase6:46365] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-11-21 13:53:25,693 DEBUG [RS:0;jenkins-hbase6:46365] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-11-21 13:53:25,693 DEBUG [RS:0;jenkins-hbase6:46365] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-11-21 13:53:25,693 DEBUG [RS:0;jenkins-hbase6:46365] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-11-21 13:53:25,693 DEBUG [RS:0;jenkins-hbase6:46365] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-11-21 13:53:25,693 DEBUG [RS:0;jenkins-hbase6:46365] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-11-21 13:53:25,693 DEBUG [RS:0;jenkins-hbase6:46365] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-11-21 13:53:25,693 DEBUG [RS:0;jenkins-hbase6:46365] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-11-21 13:53:25,694 DEBUG [RS:0;jenkins-hbase6:46365] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-11-21 13:53:25,694 INFO [RS:0;jenkins-hbase6:46365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-21 13:53:25,695 INFO [RS:0;jenkins-hbase6:46365] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-21 13:53:25,695 INFO [RS:0;jenkins-hbase6:46365] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-21 13:53:25,711 INFO [RS:0;jenkins-hbase6:46365] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-21 13:53:25,714 INFO [RS:0;jenkins-hbase6:46365] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,46365,1700574804408-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:53:25,731 INFO [RS:0;jenkins-hbase6:46365] regionserver.Replication(203): jenkins-hbase6.apache.org,46365,1700574804408 started 2023-11-21 13:53:25,732 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1637): Serving as jenkins-hbase6.apache.org,46365,1700574804408, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:46365, sessionid=0x101309c3dab0001 2023-11-21 13:53:25,732 DEBUG [RS:0;jenkins-hbase6:46365] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-21 13:53:25,732 DEBUG [RS:0;jenkins-hbase6:46365] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:25,732 DEBUG [RS:0;jenkins-hbase6:46365] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,46365,1700574804408' 2023-11-21 13:53:25,732 DEBUG [RS:0;jenkins-hbase6:46365] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:25,733 DEBUG [RS:0;jenkins-hbase6:46365] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:25,734 DEBUG [RS:0;jenkins-hbase6:46365] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-21 13:53:25,734 DEBUG [RS:0;jenkins-hbase6:46365] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-21 13:53:25,734 DEBUG [RS:0;jenkins-hbase6:46365] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:25,734 DEBUG [RS:0;jenkins-hbase6:46365] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,46365,1700574804408' 2023-11-21 13:53:25,734 DEBUG [RS:0;jenkins-hbase6:46365] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-21 13:53:25,735 DEBUG [RS:0;jenkins-hbase6:46365] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-21 13:53:25,735 DEBUG [RS:0;jenkins-hbase6:46365] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-21 13:53:25,735 INFO [RS:0;jenkins-hbase6:46365] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-21 13:53:25,735 INFO [RS:0;jenkins-hbase6:46365] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-21 13:53:25,791 DEBUG [jenkins-hbase6:43219] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-21 13:53:25,794 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,46365,1700574804408, state=OPENING 2023-11-21 13:53:25,803 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-21 13:53:25,805 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-21 13:53:25,806 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-21 13:53:25,809 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:53:25,850 INFO [RS:0;jenkins-hbase6:46365] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C46365%2C1700574804408, suffix=, logDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/WALs/jenkins-hbase6.apache.org,46365,1700574804408, archiveDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/oldWALs, maxLogs=32 2023-11-21 13:53:25,879 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45515,DS-ad5d9bc3-3914-425d-a316-f0a87e8723e3,DISK] 2023-11-21 13:53:25,883 INFO [RS:0;jenkins-hbase6:46365] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/WALs/jenkins-hbase6.apache.org,46365,1700574804408/jenkins-hbase6.apache.org%2C46365%2C1700574804408.1700574805854 2023-11-21 13:53:25,886 DEBUG [RS:0;jenkins-hbase6:46365] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45515,DS-ad5d9bc3-3914-425d-a316-f0a87e8723e3,DISK]] 2023-11-21 13:53:25,999 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:26,002 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-21 13:53:26,006 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:59772, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-21 13:53:26,020 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-21 13:53:26,020 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-21 13:53:26,024 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C46365%2C1700574804408.meta, suffix=.meta, logDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/WALs/jenkins-hbase6.apache.org,46365,1700574804408, archiveDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/oldWALs, maxLogs=32 2023-11-21 13:53:26,043 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45515,DS-ad5d9bc3-3914-425d-a316-f0a87e8723e3,DISK] 2023-11-21 13:53:26,049 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/WALs/jenkins-hbase6.apache.org,46365,1700574804408/jenkins-hbase6.apache.org%2C46365%2C1700574804408.meta.1700574806029.meta 2023-11-21 13:53:26,049 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45515,DS-ad5d9bc3-3914-425d-a316-f0a87e8723e3,DISK]] 2023-11-21 13:53:26,049 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-21 13:53:26,052 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-21 13:53:26,075 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-21 13:53:26,081 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-21 13:53:26,086 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-21 13:53:26,087 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:53:26,087 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-21 13:53:26,087 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-21 13:53:26,090 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-21 13:53:26,092 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/info 2023-11-21 13:53:26,093 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/info 2023-11-21 13:53:26,093 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-21 13:53:26,094 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:53:26,094 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-21 13:53:26,096 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/rep_barrier 2023-11-21 13:53:26,096 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/rep_barrier 2023-11-21 13:53:26,096 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-21 13:53:26,097 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:53:26,098 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-21 13:53:26,099 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/table 2023-11-21 13:53:26,099 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/table 2023-11-21 13:53:26,100 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-21 13:53:26,101 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:53:26,103 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740 2023-11-21 13:53:26,106 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740 2023-11-21 13:53:26,110 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-21 13:53:26,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-21 13:53:26,114 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63851374, jitterRate=-0.0485403835773468}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-21 13:53:26,114 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-21 13:53:26,125 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1700574805989 2023-11-21 13:53:26,142 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-21 13:53:26,142 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-21 13:53:26,143 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,46365,1700574804408, state=OPEN 2023-11-21 13:53:26,150 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-21 13:53:26,150 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-21 13:53:26,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=3, resume processing ppid=2 2023-11-21 13:53:26,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,46365,1700574804408 in 341 msec 2023-11-21 13:53:26,161 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=2, resume processing ppid=1 2023-11-21 13:53:26,161 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 535 msec 2023-11-21 13:53:26,167 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 758 msec 2023-11-21 13:53:26,167 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1700574806167, completionTime=-1 2023-11-21 13:53:26,167 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-21 13:53:26,168 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-21 13:53:26,244 DEBUG [hconnection-0x33b0120e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:53:26,247 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:59778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:53:26,264 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-21 13:53:26,264 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1700574866264 2023-11-21 13:53:26,264 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1700574926264 2023-11-21 13:53:26,264 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 96 msec 2023-11-21 13:53:26,285 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,43219,1700574803183-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:53:26,286 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,43219,1700574803183-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-21 13:53:26,286 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,43219,1700574803183-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-21 13:53:26,287 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase6:43219, period=300000, unit=MILLISECONDS is enabled. 2023-11-21 13:53:26,288 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-21 13:53:26,292 DEBUG [master/jenkins-hbase6:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-21 13:53:26,301 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-21 13:53:26,303 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-21 13:53:26,314 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-21 13:53:26,317 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-21 13:53:26,320 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-21 13:53:26,346 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/hbase/namespace/0b83305f53a4485e1244393d0f9631c7 2023-11-21 13:53:26,349 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/hbase/namespace/0b83305f53a4485e1244393d0f9631c7 empty. 2023-11-21 13:53:26,350 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/hbase/namespace/0b83305f53a4485e1244393d0f9631c7 2023-11-21 13:53:26,350 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-21 13:53:26,781 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-21 13:53:26,784 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0b83305f53a4485e1244393d0f9631c7, NAME => 'hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:53:26,797 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:53:26,798 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 0b83305f53a4485e1244393d0f9631c7, disabling compactions & flushes 2023-11-21 13:53:26,798 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7. 2023-11-21 13:53:26,798 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7. 2023-11-21 13:53:26,798 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7. after waiting 0 ms 2023-11-21 13:53:26,798 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7. 2023-11-21 13:53:26,798 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7. 2023-11-21 13:53:26,798 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 0b83305f53a4485e1244393d0f9631c7: 2023-11-21 13:53:26,803 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-21 13:53:26,820 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700574806806"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574806806"}]},"ts":"1700574806806"} 2023-11-21 13:53:26,847 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-21 13:53:26,849 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-21 13:53:26,854 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574806850"}]},"ts":"1700574806850"} 2023-11-21 13:53:26,859 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-21 13:53:26,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0b83305f53a4485e1244393d0f9631c7, ASSIGN}] 2023-11-21 13:53:26,870 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0b83305f53a4485e1244393d0f9631c7, ASSIGN 2023-11-21 13:53:26,872 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=0b83305f53a4485e1244393d0f9631c7, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:53:27,023 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0b83305f53a4485e1244393d0f9631c7, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:27,023 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700574807023"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574807023"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574807023"}]},"ts":"1700574807023"} 2023-11-21 13:53:27,028 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 0b83305f53a4485e1244393d0f9631c7, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:53:27,182 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:27,188 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7. 2023-11-21 13:53:27,188 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b83305f53a4485e1244393d0f9631c7, NAME => 'hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7.', STARTKEY => '', ENDKEY => ''} 2023-11-21 13:53:27,189 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 0b83305f53a4485e1244393d0f9631c7 2023-11-21 13:53:27,190 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:53:27,190 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 0b83305f53a4485e1244393d0f9631c7 2023-11-21 13:53:27,190 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 0b83305f53a4485e1244393d0f9631c7 2023-11-21 13:53:27,192 INFO [StoreOpener-0b83305f53a4485e1244393d0f9631c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 0b83305f53a4485e1244393d0f9631c7 2023-11-21 13:53:27,195 DEBUG [StoreOpener-0b83305f53a4485e1244393d0f9631c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/namespace/0b83305f53a4485e1244393d0f9631c7/info 2023-11-21 13:53:27,195 DEBUG [StoreOpener-0b83305f53a4485e1244393d0f9631c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/namespace/0b83305f53a4485e1244393d0f9631c7/info 2023-11-21 13:53:27,196 INFO [StoreOpener-0b83305f53a4485e1244393d0f9631c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b83305f53a4485e1244393d0f9631c7 columnFamilyName info 2023-11-21 13:53:27,197 INFO [StoreOpener-0b83305f53a4485e1244393d0f9631c7-1] regionserver.HStore(310): Store=0b83305f53a4485e1244393d0f9631c7/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:53:27,199 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/namespace/0b83305f53a4485e1244393d0f9631c7 2023-11-21 13:53:27,200 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/namespace/0b83305f53a4485e1244393d0f9631c7 2023-11-21 13:53:27,205 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 0b83305f53a4485e1244393d0f9631c7 2023-11-21 13:53:27,210 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/namespace/0b83305f53a4485e1244393d0f9631c7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:53:27,211 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 0b83305f53a4485e1244393d0f9631c7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64612918, jitterRate=-0.03719249367713928}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-21 13:53:27,211 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 0b83305f53a4485e1244393d0f9631c7: 2023-11-21 13:53:27,213 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7., pid=6, masterSystemTime=1700574807182 2023-11-21 13:53:27,217 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7. 2023-11-21 13:53:27,217 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7. 2023-11-21 13:53:27,219 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0b83305f53a4485e1244393d0f9631c7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:27,220 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700574807218"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574807218"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574807218"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574807218"}]},"ts":"1700574807218"} 2023-11-21 13:53:27,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=6, resume processing ppid=5 2023-11-21 13:53:27,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 0b83305f53a4485e1244393d0f9631c7, server=jenkins-hbase6.apache.org,46365,1700574804408 in 195 msec 2023-11-21 13:53:27,231 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=5, resume processing ppid=4 2023-11-21 13:53:27,232 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=0b83305f53a4485e1244393d0f9631c7, ASSIGN in 360 msec 2023-11-21 13:53:27,233 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-21 13:53:27,234 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574807234"}]},"ts":"1700574807234"} 2023-11-21 13:53:27,237 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-21 13:53:27,241 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-21 13:53:27,245 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 938 msec 2023-11-21 13:53:27,317 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-21 13:53:27,319 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-21 13:53:27,319 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-21 13:53:27,358 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-21 13:53:27,381 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-21 13:53:27,390 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 41 msec 2023-11-21 13:53:27,403 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-21 13:53:27,421 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-21 13:53:27,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 22 msec 2023-11-21 13:53:27,441 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-21 13:53:27,444 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-21 13:53:27,444 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.960sec 2023-11-21 13:53:27,446 INFO [master/jenkins-hbase6:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-21 13:53:27,447 INFO [master/jenkins-hbase6:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-21 13:53:27,448 INFO [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-21 13:53:27,448 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,43219,1700574803183-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-21 13:53:27,449 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,43219,1700574803183-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-21 13:53:27,454 DEBUG [Listener at localhost/35077] zookeeper.ReadOnlyZKClient(139): Connect 0x7f9c4d78 to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:53:27,461 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-21 13:53:27,461 DEBUG [Listener at localhost/35077] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77fd41f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:53:27,475 DEBUG [hconnection-0x12000246-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:53:27,487 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:59794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:53:27,499 INFO [Listener at localhost/35077] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase6.apache.org,43219,1700574803183 2023-11-21 13:53:27,502 DEBUG [Listener at localhost/35077] zookeeper.ReadOnlyZKClient(139): Connect 0x247479d3 to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:53:27,508 DEBUG [Listener at localhost/35077] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a11c17b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:53:27,508 INFO [Listener at localhost/35077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-21 13:53:27,570 INFO [Listener at localhost/35077] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=214, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=299, ProcessCount=174, AvailableMemoryMB=7741 2023-11-21 13:53:27,585 DEBUG [Listener at localhost/35077] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-21 13:53:27,588 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:35882, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-21 13:53:27,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-21 13:53:27,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:27,607 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-21 13:53:27,609 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-21 13:53:27,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-21 13:53:27,614 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362 2023-11-21 13:53:27,615 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362 empty. 2023-11-21 13:53:27,617 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362 2023-11-21 13:53:27,617 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-21 13:53:27,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-21 13:53:27,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-21 13:53:27,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-21 13:53:28,038 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-21 13:53:28,040 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 37258dbac07186fa63e6eb65c44df362, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:53:28,054 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:53:28,054 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 37258dbac07186fa63e6eb65c44df362, disabling compactions & flushes 2023-11-21 13:53:28,054 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:28,054 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:28,054 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. after waiting 0 ms 2023-11-21 13:53:28,054 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:28,054 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:28,054 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:28,059 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-21 13:53:28,060 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700574808060"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574808060"}]},"ts":"1700574808060"} 2023-11-21 13:53:28,063 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-21 13:53:28,064 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-21 13:53:28,065 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574808064"}]},"ts":"1700574808064"} 2023-11-21 13:53:28,067 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-21 13:53:28,071 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=37258dbac07186fa63e6eb65c44df362, ASSIGN}] 2023-11-21 13:53:28,072 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=37258dbac07186fa63e6eb65c44df362, ASSIGN 2023-11-21 13:53:28,074 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=37258dbac07186fa63e6eb65c44df362, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:53:28,225 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=37258dbac07186fa63e6eb65c44df362, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:28,225 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700574808225"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574808225"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574808225"}]},"ts":"1700574808225"} 2023-11-21 13:53:28,229 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 37258dbac07186fa63e6eb65c44df362, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:53:28,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-21 13:53:28,382 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:28,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:28,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 37258dbac07186fa63e6eb65c44df362, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362.', STARTKEY => '', ENDKEY => ''} 2023-11-21 13:53:28,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 37258dbac07186fa63e6eb65c44df362 2023-11-21 13:53:28,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:53:28,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 37258dbac07186fa63e6eb65c44df362 2023-11-21 13:53:28,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 37258dbac07186fa63e6eb65c44df362 2023-11-21 13:53:28,393 INFO [StoreOpener-37258dbac07186fa63e6eb65c44df362-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 37258dbac07186fa63e6eb65c44df362 2023-11-21 13:53:28,395 DEBUG [StoreOpener-37258dbac07186fa63e6eb65c44df362-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1 2023-11-21 13:53:28,395 DEBUG [StoreOpener-37258dbac07186fa63e6eb65c44df362-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1 2023-11-21 13:53:28,398 INFO [StoreOpener-37258dbac07186fa63e6eb65c44df362-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37258dbac07186fa63e6eb65c44df362 columnFamilyName family1 2023-11-21 13:53:28,401 INFO [StoreOpener-37258dbac07186fa63e6eb65c44df362-1] regionserver.HStore(310): Store=37258dbac07186fa63e6eb65c44df362/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:53:28,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362 2023-11-21 13:53:28,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362 2023-11-21 13:53:28,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 37258dbac07186fa63e6eb65c44df362 2023-11-21 13:53:28,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:53:28,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 37258dbac07186fa63e6eb65c44df362; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72333871, jitterRate=0.07785867154598236}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-21 13:53:28,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:28,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362., pid=11, masterSystemTime=1700574808382 2023-11-21 13:53:28,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:28,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:28,419 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=37258dbac07186fa63e6eb65c44df362, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:28,419 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700574808419"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574808419"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574808419"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574808419"}]},"ts":"1700574808419"} 2023-11-21 13:53:28,425 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=11, resume processing ppid=10 2023-11-21 13:53:28,426 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 37258dbac07186fa63e6eb65c44df362, server=jenkins-hbase6.apache.org,46365,1700574804408 in 193 msec 2023-11-21 13:53:28,429 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=10, resume processing ppid=9 2023-11-21 13:53:28,429 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=37258dbac07186fa63e6eb65c44df362, ASSIGN in 355 msec 2023-11-21 13:53:28,430 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-21 13:53:28,430 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574808430"}]},"ts":"1700574808430"} 2023-11-21 13:53:28,432 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-21 13:53:28,436 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-21 13:53:28,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 833 msec 2023-11-21 13:53:28,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-21 13:53:28,741 INFO [Listener at localhost/35077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-21 13:53:28,763 DEBUG [hconnection-0x2c9fcfea-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:53:28,767 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:59808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:53:28,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:28,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:28,953 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:28,953 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:28,954 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-21 13:53:28,954 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-21 13:53:28,955 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:28,955 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:28,957 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:28,957 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:28,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:28,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:28,958 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:28,958 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:28,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:28,959 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:28,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:28,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:28,960 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:28,961 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:28,962 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-21 13:53:28,962 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:28,962 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-21 13:53:28,963 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:28,963 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:28,963 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:28,963 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. started... 2023-11-21 13:53:28,964 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37258dbac07186fa63e6eb65c44df362 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-21 13:53:29,532 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113037a430a230fb416ab5403b190edd0083 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015113037a430a230fb416ab5403b190edd0083 2023-11-21 13:53:29,948 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/4e9d2222d8874568b1e6ea35c71e3ba8 2023-11-21 13:53:29,959 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/4e9d2222d8874568b1e6ea35c71e3ba8 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/4e9d2222d8874568b1e6ea35c71e3ba8 2023-11-21 13:53:29,969 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/4e9d2222d8874568b1e6ea35c71e3ba8, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-21 13:53:29,973 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 37258dbac07186fa63e6eb65c44df362 in 1009ms, sequenceid=5, compaction requested=false 2023-11-21 13:53:29,974 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:29,978 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:29,978 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:29,978 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:29,978 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:29,978 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:29,978 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-21 13:53:29,978 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-21 13:53:29,982 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:29,982 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:29,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:29,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:29,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:29,983 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:29,983 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:29,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:29,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:29,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:29,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:29,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:29,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-21 13:53:29,987 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-21 13:53:29,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22b8a787[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:29,987 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:29,991 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:29,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:29,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:29,991 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-21 13:53:29,991 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-21 13:53:29,991 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:29,991 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:29,991 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:29,995 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:29,995 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-21 13:53:29,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:29,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:29,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:29,995 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:29,995 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-21 13:53:29,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:29,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:29,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:29,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:29,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:29,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:30,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:30,001 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-21 13:53:30,001 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:30,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-21 13:53:30,001 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:30,001 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,001 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:30,004 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,005 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,005 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:30,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:30,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:30,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:30,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:30,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:30,006 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:30,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:30,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:30,008 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:30,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:30,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:30,019 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:30,019 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,019 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,019 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:30,019 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:30,019 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:30,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:30,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:30,020 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:30,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:30,020 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:30,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:30,020 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:30,021 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,023 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:30,023 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:30,123 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:30,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:30,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:30,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-21 13:53:30,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,147 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:30,147 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:30,148 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-21 13:53:30,148 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-21 13:53:30,149 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,149 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,154 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:30,154 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:30,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:30,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:30,155 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:30,155 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:30,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:30,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,157 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,158 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-21 13:53:30,158 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:30,159 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-21 13:53:30,159 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:30,167 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-21 13:53:30,167 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:30,167 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:30,167 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:30,167 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. started... 2023-11-21 13:53:30,168 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37258dbac07186fa63e6eb65c44df362 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-21 13:53:30,601 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128447fcd7c3ae1414cad0418fb1626990f to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128447fcd7c3ae1414cad0418fb1626990f 2023-11-21 13:53:31,012 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/cd3d9a952f7e49a6aadecab6ff6168f5 2023-11-21 13:53:31,022 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/cd3d9a952f7e49a6aadecab6ff6168f5 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/cd3d9a952f7e49a6aadecab6ff6168f5 2023-11-21 13:53:31,031 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/cd3d9a952f7e49a6aadecab6ff6168f5, entries=1, sequenceid=9, filesize=5.0 K 2023-11-21 13:53:31,033 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 37258dbac07186fa63e6eb65c44df362 in 865ms, sequenceid=9, compaction requested=false 2023-11-21 13:53:31,033 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:31,033 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:31,033 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:31,033 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:31,034 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,034 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-21 13:53:31,034 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-21 13:53:31,036 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,036 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:31,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:31,037 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,037 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:31,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:31,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:31,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:31,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-21 13:53:31,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bd055d0[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:31,040 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-21 13:53:31,040 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,043 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,043 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-21 13:53:31,043 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-21 13:53:31,043 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:31,044 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,044 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:31,046 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-21 13:53:31,046 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,046 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:31,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:31,046 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-21 13:53:31,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:31,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:31,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:31,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:31,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:31,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-21 13:53:31,051 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-21 13:53:31,051 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:31,051 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:31,051 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,051 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:31,054 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,054 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:31,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,054 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:31,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:31,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,059 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:31,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,061 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,068 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,068 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,068 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,068 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:31,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:31,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:31,069 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:31,069 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:31,069 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,069 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:31,069 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:31,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:31,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:31,069 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,070 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:31,070 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:31,171 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:31,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:31,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:31,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-21 13:53:31,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,191 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:31,191 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:31,192 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-21 13:53:31,192 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-21 13:53:31,192 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,193 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,195 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:31,195 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:31,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:31,196 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,196 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:31,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:31,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,197 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,197 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-21 13:53:31,197 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,197 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-21 13:53:31,198 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:31,198 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-21 13:53:31,198 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:31,198 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:31,198 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:31,198 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. started... 2023-11-21 13:53:31,199 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37258dbac07186fa63e6eb65c44df362 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:53:31,610 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-21 13:53:31,680 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512015d4025d9a158435a824c6961cff162c2 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512015d4025d9a158435a824c6961cff162c2 2023-11-21 13:53:31,682 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-21 13:53:31,683 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-21 13:53:31,695 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/37c4415802464d21a21f1cdd26f137cf 2023-11-21 13:53:31,705 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/37c4415802464d21a21f1cdd26f137cf as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/37c4415802464d21a21f1cdd26f137cf 2023-11-21 13:53:31,716 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/37c4415802464d21a21f1cdd26f137cf, entries=1, sequenceid=13, filesize=5.0 K 2023-11-21 13:53:31,717 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 37258dbac07186fa63e6eb65c44df362 in 518ms, sequenceid=13, compaction requested=true 2023-11-21 13:53:31,717 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:31,717 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:31,717 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:31,718 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:31,718 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,718 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-21 13:53:31,718 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-21 13:53:31,721 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,721 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:31,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:31,722 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,722 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:31,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:31,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:31,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:31,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-21 13:53:31,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41cd0cb[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:31,725 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-21 13:53:31,725 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,727 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,727 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-21 13:53:31,727 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-21 13:53:31,727 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:31,727 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,727 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:31,730 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,730 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-21 13:53:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,730 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:31,730 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-21 13:53:31,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:31,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:31,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:31,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-21 13:53:31,736 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-21 13:53:31,737 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:31,737 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:31,737 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,737 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:31,741 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,741 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,741 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:31,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:31,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:31,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:31,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:31,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:31,742 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:31,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,749 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:31,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,759 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,759 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,759 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,759 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,759 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,759 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,759 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,759 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:31,759 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:31,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:31,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:31,760 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:31,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:31,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:31,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-21 13:53:31,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:31,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:31,761 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:31,761 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:31,861 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:31,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:31,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:31,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-21 13:53:31,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,874 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:31,874 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:31,875 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-21 13:53:31,875 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-21 13:53:31,875 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,875 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,877 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:31,877 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:31,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:31,878 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,878 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:31,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:31,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,879 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,879 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-21 13:53:31,879 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,879 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-21 13:53:31,879 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:31,880 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-21 13:53:31,880 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:31,880 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:31,880 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:31,880 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. started... 2023-11-21 13:53:31,880 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37258dbac07186fa63e6eb65c44df362 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:53:31,905 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120502fcc252e38b477eb9fe702f8c34cf18 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120502fcc252e38b477eb9fe702f8c34cf18 2023-11-21 13:53:31,917 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/3368ef771f4b4ede95cf61d3374e7446 2023-11-21 13:53:31,927 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/3368ef771f4b4ede95cf61d3374e7446 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/3368ef771f4b4ede95cf61d3374e7446 2023-11-21 13:53:31,947 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/3368ef771f4b4ede95cf61d3374e7446, entries=1, sequenceid=17, filesize=5.0 K 2023-11-21 13:53:31,948 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 37258dbac07186fa63e6eb65c44df362 in 68ms, sequenceid=17, compaction requested=true 2023-11-21 13:53:31,948 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:31,948 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:31,949 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:31,950 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:31,950 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,950 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-21 13:53:31,950 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-21 13:53:31,953 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,953 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:31,954 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,954 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:31,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:31,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-21 13:53:31,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@303aa0f6[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:31,957 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-21 13:53:31,957 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,960 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,960 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-21 13:53:31,960 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-21 13:53:31,960 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:31,962 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,962 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:31,963 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-21 13:53:31,963 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,963 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:31,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:31,963 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-21 13:53:31,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:31,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:31,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:31,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:31,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:31,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-21 13:53:31,968 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-21 13:53:31,968 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:31,968 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:31,968 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,968 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:31,973 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,973 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:31,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:31,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,973 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:31,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:31,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:31,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:31,974 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:31,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,977 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:31,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,982 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,983 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:31,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:31,983 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:31,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:31,983 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,983 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,983 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:31,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:31,983 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,984 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:31,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:31,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:31,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:31,984 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,984 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:31,985 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:31,985 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:32,085 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:32,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:32,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:32,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-21 13:53:32,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,103 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:32,103 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:32,103 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-21 13:53:32,103 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-21 13:53:32,104 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,104 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,106 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:32,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,108 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,109 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,109 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:32,109 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,109 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-21 13:53:32,110 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,110 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-21 13:53:32,110 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:32,110 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-21 13:53:32,114 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:32,114 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:32,114 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:32,114 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. started... 2023-11-21 13:53:32,115 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37258dbac07186fa63e6eb65c44df362 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:53:32,178 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c869a7225e0e48d0a0f88523e284a97d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228c869a7225e0e48d0a0f88523e284a97d 2023-11-21 13:53:32,599 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/ce7d2f7e6dc949bd8d3336c62419a289 2023-11-21 13:53:32,607 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/ce7d2f7e6dc949bd8d3336c62419a289 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/ce7d2f7e6dc949bd8d3336c62419a289 2023-11-21 13:53:32,615 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/ce7d2f7e6dc949bd8d3336c62419a289, entries=1, sequenceid=21, filesize=5.0 K 2023-11-21 13:53:32,616 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 37258dbac07186fa63e6eb65c44df362 in 501ms, sequenceid=21, compaction requested=true 2023-11-21 13:53:32,616 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:32,617 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:32,617 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:32,617 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:32,617 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,617 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-21 13:53:32,617 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-21 13:53:32,621 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,621 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:32,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:32,621 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,621 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:32,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:32,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:32,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:32,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-21 13:53:32,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5759bde9[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:32,624 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-21 13:53:32,624 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,625 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,625 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-21 13:53:32,625 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-21 13:53:32,625 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:32,625 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,625 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:32,627 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-21 13:53:32,627 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,627 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:32,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:32,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:32,627 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-21 13:53:32,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:32,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:32,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:32,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:32,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-21 13:53:32,632 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-21 13:53:32,632 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:32,632 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:32,632 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,632 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:32,634 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,634 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:32,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:32,634 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:32,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:32,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:32,635 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:32,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:32,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,637 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:32,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,644 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,644 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,644 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:32,644 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:32,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:32,644 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:32,644 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,644 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:32,644 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:32,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:32,645 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,645 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:32,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:32,645 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:32,645 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:32,746 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:32,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:32,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:32,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-21 13:53:32,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,756 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:32,756 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:32,756 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-21 13:53:32,756 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-21 13:53:32,757 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,757 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,759 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:32,759 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:32,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:32,759 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:32,759 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:32,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:32,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,760 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,760 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-21 13:53:32,760 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:32,760 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-21 13:53:32,761 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:32,761 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-21 13:53:32,761 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:32,761 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:32,761 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:32,761 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. started... 2023-11-21 13:53:32,761 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37258dbac07186fa63e6eb65c44df362 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:53:33,186 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512317cc68ad0cd8c432cb51079d5370d089c to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512317cc68ad0cd8c432cb51079d5370d089c 2023-11-21 13:53:33,353 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-21 13:53:33,354 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-21 13:53:33,608 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/02aa7e8d78ab4b979c2e999d89a45a2b 2023-11-21 13:53:33,619 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/02aa7e8d78ab4b979c2e999d89a45a2b as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/02aa7e8d78ab4b979c2e999d89a45a2b 2023-11-21 13:53:33,629 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/02aa7e8d78ab4b979c2e999d89a45a2b, entries=1, sequenceid=25, filesize=5.0 K 2023-11-21 13:53:33,631 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 37258dbac07186fa63e6eb65c44df362 in 870ms, sequenceid=25, compaction requested=true 2023-11-21 13:53:33,631 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:33,631 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:33,631 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:33,632 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:33,632 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:33,632 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-21 13:53:33,632 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-21 13:53:33,635 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:33,635 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:33,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:33,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:33,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:33,636 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,636 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:33,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:33,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:33,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:33,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-21 13:53:33,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e5e0c07[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:33,639 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-21 13:53:33,639 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,640 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,641 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-21 13:53:33,641 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-21 13:53:33,641 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:33,641 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:33,641 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:33,644 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-21 13:53:33,644 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:33,644 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:33,644 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-21 13:53:33,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:33,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:33,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:33,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:33,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:33,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:33,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:33,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:33,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:33,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-21 13:53:33,649 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-21 13:53:33,650 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:33,650 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:33,650 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,650 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:33,654 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,654 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,654 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:33,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:33,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:33,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:33,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:33,655 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:33,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:33,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:33,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,659 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:33,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:33,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:33,663 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:33,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:33,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:33,663 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:33,663 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:33,663 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,663 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,664 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:33,664 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:33,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-21 13:53:33,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:33,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:33,664 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:33,664 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,665 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,665 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:33,665 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:33,765 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:33,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:33,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:33,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-21 13:53:33,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,777 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:33,777 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:33,778 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-21 13:53:33,778 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-21 13:53:33,778 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,778 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,780 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:33,780 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:33,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:33,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:33,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,781 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:33,781 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:33,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,783 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,783 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-21 13:53:33,783 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:33,783 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-21 13:53:33,784 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:33,784 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-21 13:53:33,784 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:33,784 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:33,784 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:33,784 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. started... 2023-11-21 13:53:33,785 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37258dbac07186fa63e6eb65c44df362 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:53:34,211 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010185e84b793d694d669832804a394bf0fd to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010185e84b793d694d669832804a394bf0fd 2023-11-21 13:53:34,622 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/b94bd0f46ada4de18ac420303be11216 2023-11-21 13:53:34,630 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/b94bd0f46ada4de18ac420303be11216 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/b94bd0f46ada4de18ac420303be11216 2023-11-21 13:53:34,639 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/b94bd0f46ada4de18ac420303be11216, entries=1, sequenceid=29, filesize=5.0 K 2023-11-21 13:53:34,640 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 37258dbac07186fa63e6eb65c44df362 in 855ms, sequenceid=29, compaction requested=true 2023-11-21 13:53:34,641 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:34,641 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:34,641 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:34,642 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:34,642 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:34,642 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-21 13:53:34,642 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-21 13:53:34,647 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:34,647 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:34,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:34,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:34,648 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,648 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:34,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:34,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:34,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:34,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:34,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-21 13:53:34,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ca60b8f[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:34,650 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-21 13:53:34,650 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,652 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,652 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-21 13:53:34,652 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-21 13:53:34,652 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:34,652 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:34,652 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:34,654 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:34,654 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-21 13:53:34,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:34,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:34,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:34,655 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:34,655 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-21 13:53:34,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:34,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:34,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:34,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:34,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:34,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:34,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-21 13:53:34,658 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-21 13:53:34,658 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:34,658 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:34,658 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,658 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:34,660 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,660 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:34,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:34,660 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:34,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:34,661 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:34,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:34,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:34,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:34,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,663 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:34,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:34,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:34,665 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:34,666 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,666 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:34,666 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,666 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:34,666 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,666 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,666 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:34,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:34,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:34,666 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:34,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:34,666 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:34,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:34,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-21 13:53:34,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:34,667 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:34,667 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:34,767 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:34,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:34,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:34,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-21 13:53:34,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,779 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:34,779 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:34,780 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-21 13:53:34,780 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-21 13:53:34,781 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,781 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,782 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:34,782 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:34,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:34,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:34,783 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:34,783 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:34,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,783 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:34,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,784 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,784 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-21 13:53:34,784 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:34,785 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-21 13:53:34,785 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:34,785 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-21 13:53:34,785 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:34,785 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:34,785 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:34,785 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. started... 2023-11-21 13:53:34,786 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37258dbac07186fa63e6eb65c44df362 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:53:35,209 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010374f026a9c3fe4c0aac54c5e51bcbc651 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010374f026a9c3fe4c0aac54c5e51bcbc651 2023-11-21 13:53:35,618 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/3aa6ad980c4c4cb19a513adbdde4315c 2023-11-21 13:53:35,626 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/3aa6ad980c4c4cb19a513adbdde4315c as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/3aa6ad980c4c4cb19a513adbdde4315c 2023-11-21 13:53:35,633 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/3aa6ad980c4c4cb19a513adbdde4315c, entries=1, sequenceid=33, filesize=5.0 K 2023-11-21 13:53:35,635 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 37258dbac07186fa63e6eb65c44df362 in 848ms, sequenceid=33, compaction requested=true 2023-11-21 13:53:35,635 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:35,635 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:35,635 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:35,635 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:35,635 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:35,635 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-21 13:53:35,635 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-21 13:53:35,638 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,638 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:35,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:35,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:35,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:35,638 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,638 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:35,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:35,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:35,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:35,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:35,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-21 13:53:35,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@297e3ffd[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:35,640 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-21 13:53:35,640 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,642 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,642 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-21 13:53:35,642 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-21 13:53:35,642 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:35,642 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:35,642 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:35,643 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:35,644 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-21 13:53:35,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:35,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:35,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:35,644 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:35,644 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-21 13:53:35,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:35,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:35,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:35,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:35,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:35,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:35,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-21 13:53:35,648 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-21 13:53:35,648 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:35,648 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:35,648 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,648 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:35,651 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,651 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:35,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:35,651 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:35,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:35,652 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:35,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:35,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:35,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:35,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:35,654 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:35,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:35,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:35,658 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:35,658 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:35,658 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:35,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:35,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:35,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:35,658 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:35,658 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,658 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:35,659 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:35,659 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,659 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,659 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,659 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:35,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:35,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:35,659 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:35,759 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:35,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:35,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:35,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-21 13:53:35,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,807 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:35,807 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:35,808 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-21 13:53:35,808 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-21 13:53:35,809 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,809 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,810 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:35,811 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:35,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:35,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:35,811 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:35,811 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:35,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,812 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,812 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,813 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:35,814 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-21 13:53:35,814 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:35,814 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-21 13:53:35,815 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:35,815 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:35,815 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:35,815 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. started... 2023-11-21 13:53:35,815 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37258dbac07186fa63e6eb65c44df362 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:53:36,234 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a3572f0424c64384bfc887cb0138c6ff to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907a3572f0424c64384bfc887cb0138c6ff 2023-11-21 13:53:36,644 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/56d24a8944a3452cb06750856241d8b1 2023-11-21 13:53:36,653 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/56d24a8944a3452cb06750856241d8b1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/56d24a8944a3452cb06750856241d8b1 2023-11-21 13:53:36,661 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/56d24a8944a3452cb06750856241d8b1, entries=1, sequenceid=37, filesize=5.0 K 2023-11-21 13:53:36,663 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 37258dbac07186fa63e6eb65c44df362 in 848ms, sequenceid=37, compaction requested=true 2023-11-21 13:53:36,663 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:36,663 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:36,663 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:36,664 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:36,664 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:36,664 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-21 13:53:36,664 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-21 13:53:36,666 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:36,666 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:36,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:36,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:36,667 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,667 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:36,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:36,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:36,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:36,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:36,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-21 13:53:36,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33d279ce[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:36,669 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-21 13:53:36,669 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,671 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,671 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-21 13:53:36,671 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-21 13:53:36,671 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:36,671 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:36,671 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:36,673 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-21 13:53:36,673 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:36,673 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:36,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:36,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:36,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:36,673 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-21 13:53:36,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:36,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:36,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:36,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:36,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:36,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:36,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-21 13:53:36,682 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-21 13:53:36,682 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:36,682 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:36,682 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,682 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:36,686 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,686 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:36,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:36,686 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:36,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:36,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:36,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:36,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,689 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:36,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:36,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:36,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:36,692 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:36,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:36,700 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:36,700 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:36,700 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:36,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:36,700 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:36,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:36,700 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:36,700 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:36,700 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:36,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:36,701 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:36,702 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,702 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,702 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:36,702 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:36,802 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:36,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:36,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:36,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-21 13:53:36,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,815 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:36,815 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:36,815 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-21 13:53:36,815 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-21 13:53:36,816 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,816 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,818 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:36,818 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:36,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:36,818 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:36,818 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:36,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,819 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,822 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-21 13:53:36,822 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:36,823 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-21 13:53:36,823 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:36,824 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-21 13:53:36,824 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:36,824 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:36,824 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:36,824 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. started... 2023-11-21 13:53:36,824 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 37258dbac07186fa63e6eb65c44df362 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:53:37,257 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120df946c13f3df441b8643d659b3023b03 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120df946c13f3df441b8643d659b3023b03 2023-11-21 13:53:37,666 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/18fbda6f26b34d70874619219804b8bd 2023-11-21 13:53:37,675 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/18fbda6f26b34d70874619219804b8bd as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/18fbda6f26b34d70874619219804b8bd 2023-11-21 13:53:37,682 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/18fbda6f26b34d70874619219804b8bd, entries=1, sequenceid=41, filesize=5.0 K 2023-11-21 13:53:37,683 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 37258dbac07186fa63e6eb65c44df362 in 859ms, sequenceid=41, compaction requested=true 2023-11-21 13:53:37,683 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:37,683 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:37,683 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:37,684 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:37,684 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:37,684 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-21 13:53:37,684 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-21 13:53:37,686 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:37,686 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:37,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:37,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:37,686 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,687 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:37,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:37,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:37,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:37,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:37,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-21 13:53:37,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6db27587[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:37,688 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-21 13:53:37,688 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,690 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,690 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-21 13:53:37,690 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-21 13:53:37,690 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:37,690 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:37,690 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:37,697 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:37,697 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-21 13:53:37,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:37,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:37,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:37,697 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:37,697 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-21 13:53:37,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:37,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:37,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:37,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:37,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:37,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:37,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-21 13:53:37,706 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-21 13:53:37,706 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:37,706 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:37,706 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,706 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:37,708 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,708 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:37,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:37,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,708 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:37,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:37,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:37,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:37,709 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:37,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:37,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:37,711 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:37,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:37,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:37,715 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:37,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:37,715 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:37,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:37,715 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:37,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-21 13:53:37,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:37,715 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:37,715 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,715 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,715 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:37,715 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,715 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,715 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,716 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:37,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:37,716 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:37,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:37,816 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:37,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:37,824 DEBUG [Listener at localhost/35077] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-21 13:53:37,827 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:44150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-21 13:53:37,835 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43219] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:37,859 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-21 13:53:37,860 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-21 13:53:37,862 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:53:37,862 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700575417862 2023-11-21 13:53:37,864 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-21 13:53:37,870 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-21 13:53:37,870 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-21 13:53:37,872 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] zookeeper.ReadOnlyZKClient(139): Connect 0x589356ff to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:53:37,879 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53f07fd0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:53:37,886 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-21 13:53:38,376 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010308444c252ffe442cb1974918984df384 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010308444c252ffe442cb1974918984df384 2023-11-21 13:53:38,377 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-21 13:53:38,398 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:53:38,400 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:44066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:53:38,411 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-21 13:53:38,413 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:44158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-21 13:53:38,451 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ffe059e6597a4e3c82071457a2f168c4 first=Optional[r3] last=Optional[r6] 2023-11-21 13:53:38,466 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ffe059e6597a4e3c82071457a2f168c4}] 2023-11-21 13:53:38,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ffe059e6597a4e3c82071457a2f168c4 for inclusion in 37258dbac07186fa63e6eb65c44df362/family1 2023-11-21 13:53:38,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-21 13:53:38,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:53:38,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:38,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ffe059e6597a4e3c82071457a2f168c4 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7pscd7jb5pqusodb20guqthonrros8h61g8nl7b3esilfra5ju5i1sth9q2euk19/family1/ffe059e6597a4e3c82071457a2f168c4 2023-11-21 13:53:38,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7pscd7jb5pqusodb20guqthonrros8h61g8nl7b3esilfra5ju5i1sth9q2euk19/family1/ffe059e6597a4e3c82071457a2f168c4 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/27fc1f9577274dbeab457b37cd67eeff_SeqId_44_ 2023-11-21 13:53:38,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7pscd7jb5pqusodb20guqthonrros8h61g8nl7b3esilfra5ju5i1sth9q2euk19/family1/ffe059e6597a4e3c82071457a2f168c4 into 37258dbac07186fa63e6eb65c44df362/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/27fc1f9577274dbeab457b37cd67eeff_SeqId_44_ - updating store file list. 2023-11-21 13:53:38,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/27fc1f9577274dbeab457b37cd67eeff_SeqId_44_ into 37258dbac07186fa63e6eb65c44df362/family1 2023-11-21 13:53:38,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7pscd7jb5pqusodb20guqthonrros8h61g8nl7b3esilfra5ju5i1sth9q2euk19/family1/ffe059e6597a4e3c82071457a2f168c4 into 37258dbac07186fa63e6eb65c44df362/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/27fc1f9577274dbeab457b37cd67eeff_SeqId_44_) 2023-11-21 13:53:38,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7pscd7jb5pqusodb20guqthonrros8h61g8nl7b3esilfra5ju5i1sth9q2euk19/family1/ffe059e6597a4e3c82071457a2f168c4 2023-11-21 13:53:38,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-21 13:53:38,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-21 13:53:38,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(1912): 37258dbac07186fa63e6eb65c44df362/family1 is initiating minor compaction 2023-11-21 13:53:38,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@58d713f7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:53:38,519 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 37258dbac07186fa63e6eb65c44df362/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:38,520 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/cd3d9a952f7e49a6aadecab6ff6168f5, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/37c4415802464d21a21f1cdd26f137cf, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/3368ef771f4b4ede95cf61d3374e7446, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/ce7d2f7e6dc949bd8d3336c62419a289, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/02aa7e8d78ab4b979c2e999d89a45a2b, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/b94bd0f46ada4de18ac420303be11216, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/3aa6ad980c4c4cb19a513adbdde4315c, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/56d24a8944a3452cb06750856241d8b1, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/18fbda6f26b34d70874619219804b8bd, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/27fc1f9577274dbeab457b37cd67eeff_SeqId_44_] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp, totalSize=50.2 K 2023-11-21 13:53:38,521 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting cd3d9a952f7e49a6aadecab6ff6168f5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-21 13:53:38,521 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 37c4415802464d21a21f1cdd26f137cf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-21 13:53:38,521 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 3368ef771f4b4ede95cf61d3374e7446, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-21 13:53:38,521 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting ce7d2f7e6dc949bd8d3336c62419a289, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-21 13:53:38,521 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 02aa7e8d78ab4b979c2e999d89a45a2b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-21 13:53:38,521 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting b94bd0f46ada4de18ac420303be11216, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-21 13:53:38,521 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 3aa6ad980c4c4cb19a513adbdde4315c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-21 13:53:38,521 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 56d24a8944a3452cb06750856241d8b1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-21 13:53:38,521 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 18fbda6f26b34d70874619219804b8bd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-21 13:53:38,522 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 27fc1f9577274dbeab457b37cd67eeff_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-21 13:53:38,534 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-21 13:53:38,536 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:53:38,542 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228c869a7225e0e48d0a0f88523e284a97d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228c869a7225e0e48d0a0f88523e284a97d 2023-11-21 13:53:38,543 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512317cc68ad0cd8c432cb51079d5370d089c to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512317cc68ad0cd8c432cb51079d5370d089c 2023-11-21 13:53:38,546 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010185e84b793d694d669832804a394bf0fd to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010185e84b793d694d669832804a394bf0fd 2023-11-21 13:53:38,547 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010374f026a9c3fe4c0aac54c5e51bcbc651 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010374f026a9c3fe4c0aac54c5e51bcbc651 2023-11-21 13:53:38,548 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-21 13:53:38,548 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-21 13:53:38,548 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-21 13:53:38,548 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-21 13:53:38,548 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-21 13:53:38,549 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-21 13:53:38,549 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-21 13:53:38,549 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-21 13:53:38,549 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-21 13:53:38,549 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-21 13:53:38,601 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 37258dbac07186fa63e6eb65c44df362#family1#compaction#10 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:53:39,057 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/7e5797e6993940c396add9ab9088106f as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/7e5797e6993940c396add9ab9088106f 2023-11-21 13:53:39,077 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 37258dbac07186fa63e6eb65c44df362/family1 of 37258dbac07186fa63e6eb65c44df362 into 7e5797e6993940c396add9ab9088106f(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:53:39,077 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:39,079 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1700574818518; duration=0sec 2023-11-21 13:53:39,080 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:53:39,111 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/cd3d9a952f7e49a6aadecab6ff6168f5, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/37c4415802464d21a21f1cdd26f137cf, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/3368ef771f4b4ede95cf61d3374e7446, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/ce7d2f7e6dc949bd8d3336c62419a289, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/02aa7e8d78ab4b979c2e999d89a45a2b, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/b94bd0f46ada4de18ac420303be11216, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/3aa6ad980c4c4cb19a513adbdde4315c, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/56d24a8944a3452cb06750856241d8b1, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/18fbda6f26b34d70874619219804b8bd, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/27fc1f9577274dbeab457b37cd67eeff_SeqId_44_] to archive 2023-11-21 13:53:39,113 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:53:39,116 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/cd3d9a952f7e49a6aadecab6ff6168f5 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/cd3d9a952f7e49a6aadecab6ff6168f5 2023-11-21 13:53:39,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/37c4415802464d21a21f1cdd26f137cf to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/37c4415802464d21a21f1cdd26f137cf 2023-11-21 13:53:39,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/3368ef771f4b4ede95cf61d3374e7446 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/3368ef771f4b4ede95cf61d3374e7446 2023-11-21 13:53:39,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/ce7d2f7e6dc949bd8d3336c62419a289 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/ce7d2f7e6dc949bd8d3336c62419a289 2023-11-21 13:53:39,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/02aa7e8d78ab4b979c2e999d89a45a2b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/02aa7e8d78ab4b979c2e999d89a45a2b 2023-11-21 13:53:39,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/b94bd0f46ada4de18ac420303be11216 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/b94bd0f46ada4de18ac420303be11216 2023-11-21 13:53:39,126 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/3aa6ad980c4c4cb19a513adbdde4315c to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/3aa6ad980c4c4cb19a513adbdde4315c 2023-11-21 13:53:39,128 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/56d24a8944a3452cb06750856241d8b1 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/56d24a8944a3452cb06750856241d8b1 2023-11-21 13:53:39,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/18fbda6f26b34d70874619219804b8bd to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/18fbda6f26b34d70874619219804b8bd 2023-11-21 13:53:39,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/27fc1f9577274dbeab457b37cd67eeff_SeqId_44_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/27fc1f9577274dbeab457b37cd67eeff_SeqId_44_ 2023-11-21 13:53:39,506 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120515bcb49621164e129fec627b39e153b4 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120515bcb49621164e129fec627b39e153b4 2023-11-21 13:53:39,509 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-21 13:53:39,539 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a79f8931e5104cff9be44c3426ea49d1 first=Optional[r00] last=Optional[r2] 2023-11-21 13:53:39,540 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a79f8931e5104cff9be44c3426ea49d1}] 2023-11-21 13:53:39,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a79f8931e5104cff9be44c3426ea49d1 for inclusion in 37258dbac07186fa63e6eb65c44df362/family1 2023-11-21 13:53:39,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-21 13:53:39,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:53:39,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:39,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a79f8931e5104cff9be44c3426ea49d1 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__s9f21fciqrjh1epnb1d83c687a2f7dgs2ocddr4lced218v5nsffi505n4v6bdmg/family1/a79f8931e5104cff9be44c3426ea49d1 2023-11-21 13:53:39,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__s9f21fciqrjh1epnb1d83c687a2f7dgs2ocddr4lced218v5nsffi505n4v6bdmg/family1/a79f8931e5104cff9be44c3426ea49d1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/1e5a7b7045f24251b8ee30c52e633036_SeqId_47_ 2023-11-21 13:53:39,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__s9f21fciqrjh1epnb1d83c687a2f7dgs2ocddr4lced218v5nsffi505n4v6bdmg/family1/a79f8931e5104cff9be44c3426ea49d1 into 37258dbac07186fa63e6eb65c44df362/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/1e5a7b7045f24251b8ee30c52e633036_SeqId_47_ - updating store file list. 2023-11-21 13:53:39,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/1e5a7b7045f24251b8ee30c52e633036_SeqId_47_ into 37258dbac07186fa63e6eb65c44df362/family1 2023-11-21 13:53:39,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__s9f21fciqrjh1epnb1d83c687a2f7dgs2ocddr4lced218v5nsffi505n4v6bdmg/family1/a79f8931e5104cff9be44c3426ea49d1 into 37258dbac07186fa63e6eb65c44df362/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/1e5a7b7045f24251b8ee30c52e633036_SeqId_47_) 2023-11-21 13:53:39,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__s9f21fciqrjh1epnb1d83c687a2f7dgs2ocddr4lced218v5nsffi505n4v6bdmg/family1/a79f8931e5104cff9be44c3426ea49d1 2023-11-21 13:53:39,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-21 13:53:39,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-21 13:53:39,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(1912): 37258dbac07186fa63e6eb65c44df362/family1 is initiating minor compaction (all files) 2023-11-21 13:53:39,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5b45ade7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:53:39,563 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 37258dbac07186fa63e6eb65c44df362/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:39,564 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/4e9d2222d8874568b1e6ea35c71e3ba8, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/7e5797e6993940c396add9ab9088106f, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/1e5a7b7045f24251b8ee30c52e633036_SeqId_47_] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp, totalSize=358.6 K 2023-11-21 13:53:39,564 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 4e9d2222d8874568b1e6ea35c71e3ba8, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878827509 2023-11-21 13:53:39,565 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 7e5797e6993940c396add9ab9088106f, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621227509 2023-11-21 13:53:39,566 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 1e5a7b7045f24251b8ee30c52e633036_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878827509 2023-11-21 13:53:39,566 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-21 13:53:39,568 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:53:39,570 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015113037a430a230fb416ab5403b190edd0083 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015113037a430a230fb416ab5403b190edd0083 2023-11-21 13:53:39,572 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512015d4025d9a158435a824c6961cff162c2 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512015d4025d9a158435a824c6961cff162c2 2023-11-21 13:53:39,574 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120502fcc252e38b477eb9fe702f8c34cf18 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120502fcc252e38b477eb9fe702f8c34cf18 2023-11-21 13:53:39,574 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-21 13:53:39,574 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-21 13:53:39,574 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-21 13:53:39,574 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-21 13:53:39,575 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:53:39,576 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-21 13:53:39,578 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.7320 sec 2023-11-21 13:53:39,605 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 37258dbac07186fa63e6eb65c44df362#family1#compaction#11 average throughput is 6.61 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:53:39,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$12(2454): Client=jenkins//172.31.2.20 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-21 13:53:39,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:40,198 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-21 13:53:40,201 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-21 13:53:40,201 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-21 13:53:40,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-21 13:53:40,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=37258dbac07186fa63e6eb65c44df362, REOPEN/MOVE}] 2023-11-21 13:53:40,219 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=37258dbac07186fa63e6eb65c44df362, REOPEN/MOVE 2023-11-21 13:53:40,220 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=37258dbac07186fa63e6eb65c44df362, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:40,220 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700574820220"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574820220"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574820220"}]},"ts":"1700574820220"} 2023-11-21 13:53:40,223 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 37258dbac07186fa63e6eb65c44df362, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:53:40,381 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:40,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close 37258dbac07186fa63e6eb65c44df362 2023-11-21 13:53:40,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 37258dbac07186fa63e6eb65c44df362, disabling compactions & flushes 2023-11-21 13:53:40,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:40,838 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/.tmp/family1/9e2b954526604c51926cf983366f9b2f as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/9e2b954526604c51926cf983366f9b2f 2023-11-21 13:53:40,846 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 37258dbac07186fa63e6eb65c44df362/family1 of 37258dbac07186fa63e6eb65c44df362 into 9e2b954526604c51926cf983366f9b2f(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-21 13:53:40,846 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:40,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:40,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:40,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. after waiting 0 ms 2023-11-21 13:53:40,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:40,847 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1700574819563; duration=1sec 2023-11-21 13:53:40,847 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:53:40,849 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/4e9d2222d8874568b1e6ea35c71e3ba8, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/7e5797e6993940c396add9ab9088106f, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/1e5a7b7045f24251b8ee30c52e633036_SeqId_47_] to archive 2023-11-21 13:53:40,850 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:53:40,853 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/4e9d2222d8874568b1e6ea35c71e3ba8 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/4e9d2222d8874568b1e6ea35c71e3ba8 2023-11-21 13:53:40,854 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/7e5797e6993940c396add9ab9088106f to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/7e5797e6993940c396add9ab9088106f 2023-11-21 13:53:40,856 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/1e5a7b7045f24251b8ee30c52e633036_SeqId_47_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/1e5a7b7045f24251b8ee30c52e633036_SeqId_47_ 2023-11-21 13:53:40,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-21 13:53:40,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:40,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:40,863 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 37258dbac07186fa63e6eb65c44df362 to self. 2023-11-21 13:53:40,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed 37258dbac07186fa63e6eb65c44df362 2023-11-21 13:53:40,865 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=37258dbac07186fa63e6eb65c44df362, regionState=CLOSED 2023-11-21 13:53:40,865 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700574820865"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574820865"}]},"ts":"1700574820865"} 2023-11-21 13:53:40,869 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=16, resume processing ppid=15 2023-11-21 13:53:40,869 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 37258dbac07186fa63e6eb65c44df362, server=jenkins-hbase6.apache.org,46365,1700574804408 in 644 msec 2023-11-21 13:53:40,870 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=37258dbac07186fa63e6eb65c44df362, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=true 2023-11-21 13:53:41,020 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=37258dbac07186fa63e6eb65c44df362, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:41,021 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700574821020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574821020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574821020"}]},"ts":"1700574821020"} 2023-11-21 13:53:41,023 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 37258dbac07186fa63e6eb65c44df362, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:53:41,175 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:41,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:41,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 37258dbac07186fa63e6eb65c44df362, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362.', STARTKEY => '', ENDKEY => ''} 2023-11-21 13:53:41,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 37258dbac07186fa63e6eb65c44df362 2023-11-21 13:53:41,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:53:41,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 37258dbac07186fa63e6eb65c44df362 2023-11-21 13:53:41,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 37258dbac07186fa63e6eb65c44df362 2023-11-21 13:53:41,181 INFO [StoreOpener-37258dbac07186fa63e6eb65c44df362-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 37258dbac07186fa63e6eb65c44df362 2023-11-21 13:53:41,182 DEBUG [StoreOpener-37258dbac07186fa63e6eb65c44df362-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1 2023-11-21 13:53:41,182 DEBUG [StoreOpener-37258dbac07186fa63e6eb65c44df362-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1 2023-11-21 13:53:41,182 INFO [StoreOpener-37258dbac07186fa63e6eb65c44df362-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37258dbac07186fa63e6eb65c44df362 columnFamilyName family1 2023-11-21 13:53:41,189 DEBUG [StoreOpener-37258dbac07186fa63e6eb65c44df362-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/9e2b954526604c51926cf983366f9b2f 2023-11-21 13:53:41,190 INFO [StoreOpener-37258dbac07186fa63e6eb65c44df362-1] regionserver.HStore(310): Store=37258dbac07186fa63e6eb65c44df362/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:53:41,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362 2023-11-21 13:53:41,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362 2023-11-21 13:53:41,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 37258dbac07186fa63e6eb65c44df362 2023-11-21 13:53:41,196 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 37258dbac07186fa63e6eb65c44df362; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64443767, jitterRate=-0.03971303999423981}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-21 13:53:41,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:41,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362., pid=17, masterSystemTime=1700574821175 2023-11-21 13:53:41,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:41,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:53:41,200 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=37258dbac07186fa63e6eb65c44df362, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:41,200 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700574821200"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574821200"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574821200"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574821200"}]},"ts":"1700574821200"} 2023-11-21 13:53:41,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=17, resume processing ppid=15 2023-11-21 13:53:41,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 37258dbac07186fa63e6eb65c44df362, server=jenkins-hbase6.apache.org,46365,1700574804408 in 179 msec 2023-11-21 13:53:41,206 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=15, resume processing ppid=14 2023-11-21 13:53:41,206 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=37258dbac07186fa63e6eb65c44df362, REOPEN/MOVE in 986 msec 2023-11-21 13:53:41,210 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=14, resume processing ppid=13 2023-11-21 13:53:41,210 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0040 sec 2023-11-21 13:53:41,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.4380 sec 2023-11-21 13:53:41,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-21 13:53:41,222 INFO [Listener at localhost/35077] compactions.TestMobCompactor(278): alter status finished 2023-11-21 13:53:41,223 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43219] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-21 13:53:41,224 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-21 13:53:41,225 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-21 13:53:41,226 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:53:41,226 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700575421226 2023-11-21 13:53:41,227 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-21 13:53:41,228 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-21 13:53:41,228 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-21 13:53:41,229 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] zookeeper.ReadOnlyZKClient(139): Connect 0x2c080524 to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:53:41,295 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b8ef1de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:53:41,295 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-21 13:53:41,295 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-21 13:53:41,295 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-21 13:53:41,296 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-21 13:53:41,296 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-21 13:53:42,137 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128922cd05430134facb7118a40172fdca3 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128922cd05430134facb7118a40172fdca3 2023-11-21 13:53:42,138 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-21 13:53:42,152 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:53:42,153 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:36466, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:53:42,160 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-21 13:53:42,162 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:34338, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-21 13:53:42,172 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fd35b846fe294d46a9b033e4b1f9cbcf first=Optional[r05] last=Optional[r8] 2023-11-21 13:53:42,172 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=51 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fd35b846fe294d46a9b033e4b1f9cbcf}] 2023-11-21 13:53:42,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fd35b846fe294d46a9b033e4b1f9cbcf for inclusion in 37258dbac07186fa63e6eb65c44df362/family1 2023-11-21 13:53:42,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-21 13:53:42,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:53:42,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:53:42,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fd35b846fe294d46a9b033e4b1f9cbcf to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__j5g1rcs88jrnmqnsnqhl3dtiu7gjvge0nlj09cur5aidfij6nq5iftsd1e2jprm0/family1/fd35b846fe294d46a9b033e4b1f9cbcf 2023-11-21 13:53:42,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__j5g1rcs88jrnmqnsnqhl3dtiu7gjvge0nlj09cur5aidfij6nq5iftsd1e2jprm0/family1/fd35b846fe294d46a9b033e4b1f9cbcf as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/a07356de03b14b56a52359b87f33c96c_SeqId_53_ 2023-11-21 13:53:42,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__j5g1rcs88jrnmqnsnqhl3dtiu7gjvge0nlj09cur5aidfij6nq5iftsd1e2jprm0/family1/fd35b846fe294d46a9b033e4b1f9cbcf into 37258dbac07186fa63e6eb65c44df362/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/a07356de03b14b56a52359b87f33c96c_SeqId_53_ - updating store file list. 2023-11-21 13:53:42,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/a07356de03b14b56a52359b87f33c96c_SeqId_53_ into 37258dbac07186fa63e6eb65c44df362/family1 2023-11-21 13:53:42,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__j5g1rcs88jrnmqnsnqhl3dtiu7gjvge0nlj09cur5aidfij6nq5iftsd1e2jprm0/family1/fd35b846fe294d46a9b033e4b1f9cbcf into 37258dbac07186fa63e6eb65c44df362/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/family1/a07356de03b14b56a52359b87f33c96c_SeqId_53_) 2023-11-21 13:53:42,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__j5g1rcs88jrnmqnsnqhl3dtiu7gjvge0nlj09cur5aidfij6nq5iftsd1e2jprm0/family1/fd35b846fe294d46a9b033e4b1f9cbcf 2023-11-21 13:53:42,194 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-21 13:53:42,195 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:53:42,197 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120df946c13f3df441b8643d659b3023b03 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120df946c13f3df441b8643d659b3023b03 2023-11-21 13:53:42,198 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128447fcd7c3ae1414cad0418fb1626990f to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128447fcd7c3ae1414cad0418fb1626990f 2023-11-21 13:53:42,198 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-21 13:53:42,198 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-21 13:53:42,199 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-21 13:53:42,199 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-21 13:53:42,199 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-21 13:53:42,199 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-21 13:53:42,199 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:53:42,200 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-21 13:53:42,201 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 976 msec 2023-11-21 13:53:42,296 INFO [Listener at localhost/35077] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=250 (was 214) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:39950 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2de6e8fd-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52369@0x589356ff sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1332557819.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:40156 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52369@0x2c080524 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1332557819.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_663891427_17 at /127.0.0.1:40126 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:40046 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404f994d-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:39924 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52369@0x2c080524-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:39966 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:40084 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:40162 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2de6e8fd-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:39998 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404f994d-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52369@0x589356ff-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:40062 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:39980 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52369@0x589356ff-SendThread(127.0.0.1:52369) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:40048 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:40110 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:39896 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase6:46365-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:39978 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:40078 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404f994d-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52369@0x2c080524-SendThread(127.0.0.1:52369) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) - Thread LEAK? -, OpenFileDescriptor=620 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=292 (was 299), ProcessCount=174 (was 174), AvailableMemoryMB=7342 (was 7741) 2023-11-21 13:53:42,320 INFO [Listener at localhost/35077] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=250, OpenFileDescriptor=620, MaxFileDescriptor=60000, SystemLoadAverage=292, ProcessCount=174, AvailableMemoryMB=7340 2023-11-21 13:53:42,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-21 13:53:42,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:42,327 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-21 13:53:42,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-21 13:53:42,328 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-21 13:53:42,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-21 13:53:42,330 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750 2023-11-21 13:53:42,331 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750 empty. 2023-11-21 13:53:42,332 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750 2023-11-21 13:53:42,332 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-21 13:53:42,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-21 13:53:42,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-21 13:53:42,745 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-21 13:53:42,747 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1747855f64ddd440c8691d3cb9a8c750, NAME => 'testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:53:42,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-21 13:53:43,154 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:53:43,154 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 1747855f64ddd440c8691d3cb9a8c750, disabling compactions & flushes 2023-11-21 13:53:43,154 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:43,154 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:43,154 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. after waiting 0 ms 2023-11-21 13:53:43,154 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:43,154 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:43,154 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 1747855f64ddd440c8691d3cb9a8c750: 2023-11-21 13:53:43,158 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-21 13:53:43,159 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700574823159"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574823159"}]},"ts":"1700574823159"} 2023-11-21 13:53:43,162 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-21 13:53:43,163 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-21 13:53:43,163 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574823163"}]},"ts":"1700574823163"} 2023-11-21 13:53:43,165 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-21 13:53:43,170 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=1747855f64ddd440c8691d3cb9a8c750, ASSIGN}] 2023-11-21 13:53:43,177 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=1747855f64ddd440c8691d3cb9a8c750, ASSIGN 2023-11-21 13:53:43,178 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=1747855f64ddd440c8691d3cb9a8c750, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:53:43,329 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=1747855f64ddd440c8691d3cb9a8c750, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:43,329 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700574823329"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574823329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574823329"}]},"ts":"1700574823329"} 2023-11-21 13:53:43,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 1747855f64ddd440c8691d3cb9a8c750, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:53:43,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-21 13:53:43,484 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:43,490 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:43,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1747855f64ddd440c8691d3cb9a8c750, NAME => 'testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750.', STARTKEY => '', ENDKEY => ''} 2023-11-21 13:53:43,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 1747855f64ddd440c8691d3cb9a8c750 2023-11-21 13:53:43,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:53:43,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 1747855f64ddd440c8691d3cb9a8c750 2023-11-21 13:53:43,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 1747855f64ddd440c8691d3cb9a8c750 2023-11-21 13:53:43,493 INFO [StoreOpener-1747855f64ddd440c8691d3cb9a8c750-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1747855f64ddd440c8691d3cb9a8c750 2023-11-21 13:53:43,497 DEBUG [StoreOpener-1747855f64ddd440c8691d3cb9a8c750-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1 2023-11-21 13:53:43,497 DEBUG [StoreOpener-1747855f64ddd440c8691d3cb9a8c750-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1 2023-11-21 13:53:43,498 INFO [StoreOpener-1747855f64ddd440c8691d3cb9a8c750-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1747855f64ddd440c8691d3cb9a8c750 columnFamilyName family1 2023-11-21 13:53:43,503 INFO [StoreOpener-1747855f64ddd440c8691d3cb9a8c750-1] regionserver.HStore(310): Store=1747855f64ddd440c8691d3cb9a8c750/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:53:43,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750 2023-11-21 13:53:43,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750 2023-11-21 13:53:43,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 1747855f64ddd440c8691d3cb9a8c750 2023-11-21 13:53:43,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:53:43,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 1747855f64ddd440c8691d3cb9a8c750; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70040402, jitterRate=0.04368332028388977}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-21 13:53:43,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 1747855f64ddd440c8691d3cb9a8c750: 2023-11-21 13:53:43,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750., pid=21, masterSystemTime=1700574823484 2023-11-21 13:53:43,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:43,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:43,519 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=1747855f64ddd440c8691d3cb9a8c750, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:43,519 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700574823519"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574823519"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574823519"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574823519"}]},"ts":"1700574823519"} 2023-11-21 13:53:43,524 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=21, resume processing ppid=20 2023-11-21 13:53:43,524 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 1747855f64ddd440c8691d3cb9a8c750, server=jenkins-hbase6.apache.org,46365,1700574804408 in 189 msec 2023-11-21 13:53:43,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=20, resume processing ppid=19 2023-11-21 13:53:43,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=1747855f64ddd440c8691d3cb9a8c750, ASSIGN in 354 msec 2023-11-21 13:53:43,527 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-21 13:53:43,527 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574823527"}]},"ts":"1700574823527"} 2023-11-21 13:53:43,529 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-21 13:53:43,533 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-21 13:53:43,535 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.2100 sec 2023-11-21 13:53:43,685 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:44,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-21 13:53:44,436 INFO [Listener at localhost/35077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-21 13:53:44,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:44,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:44,477 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:44,477 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:44,478 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:53:44,478 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:53:44,480 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:44,480 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:44,482 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:44,482 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:44,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:44,482 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:44,482 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:44,483 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:44,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:44,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:44,484 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:44,485 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:44,485 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:53:44,485 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:44,485 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:53:44,486 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:44,486 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:44,486 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:44,486 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. started... 2023-11-21 13:53:44,487 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1747855f64ddd440c8691d3cb9a8c750 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-21 13:53:44,919 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113091970b1ee05f484b8d78867a6ba3f9d7 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113091970b1ee05f484b8d78867a6ba3f9d7 2023-11-21 13:53:45,323 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/708476994d334a4fbe6e4d0db8b4daac 2023-11-21 13:53:45,330 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/708476994d334a4fbe6e4d0db8b4daac as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/708476994d334a4fbe6e4d0db8b4daac 2023-11-21 13:53:45,336 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/708476994d334a4fbe6e4d0db8b4daac, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-21 13:53:45,337 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1747855f64ddd440c8691d3cb9a8c750 in 850ms, sequenceid=5, compaction requested=false 2023-11-21 13:53:45,338 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1747855f64ddd440c8691d3cb9a8c750: 2023-11-21 13:53:45,338 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:45,338 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:45,338 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:45,338 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:45,338 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:53:45,338 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:53:45,340 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:45,340 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:45,341 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:45,341 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:45,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:45,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:45,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:45,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:53:45,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11b4f1cd[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:45,342 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:53:45,342 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,344 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,344 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:53:45,344 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:53:45,344 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:45,344 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:45,344 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:45,346 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:45,346 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:53:45,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:45,346 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:45,347 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:53:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:45,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:45,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:45,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:45,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:45,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:45,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:53:45,350 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:53:45,350 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:45,350 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:45,350 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,350 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:45,352 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,352 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,352 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:45,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:45,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:45,353 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:45,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:45,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:45,354 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:45,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:45,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:45,366 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:45,366 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,366 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:45,366 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:45,366 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:45,366 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:45,366 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:45,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:45,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:45,366 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:45,367 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,367 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,367 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:45,367 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:45,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:45,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:45,468 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:45,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:45,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:45,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:53:45,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,475 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:45,475 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:45,476 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:53:45,476 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:53:45,476 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,476 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,477 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:45,477 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:45,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:45,478 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:45,478 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,479 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,479 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-21 13:53:45,479 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:45,479 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:53:45,479 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:45,480 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:53:45,480 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:45,480 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:45,480 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:45,480 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. started... 2023-11-21 13:53:45,480 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1747855f64ddd440c8691d3cb9a8c750 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-21 13:53:45,895 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112889e6eacf2dda4fb296a53b595222fbec to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112889e6eacf2dda4fb296a53b595222fbec 2023-11-21 13:53:46,302 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/802559530b7f40fa897a2fac04d1a2c2 2023-11-21 13:53:46,309 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/802559530b7f40fa897a2fac04d1a2c2 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/802559530b7f40fa897a2fac04d1a2c2 2023-11-21 13:53:46,316 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/802559530b7f40fa897a2fac04d1a2c2, entries=1, sequenceid=9, filesize=5.0 K 2023-11-21 13:53:46,317 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1747855f64ddd440c8691d3cb9a8c750 in 837ms, sequenceid=9, compaction requested=false 2023-11-21 13:53:46,317 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1747855f64ddd440c8691d3cb9a8c750: 2023-11-21 13:53:46,318 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:46,318 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:46,318 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:46,318 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:46,318 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:53:46,318 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:53:46,320 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:46,320 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:46,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:46,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:46,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:46,321 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,321 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:46,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:46,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:46,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:46,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:53:46,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49edb5d1[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:46,324 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:53:46,324 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,327 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:46,327 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:46,330 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,331 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:53:46,331 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:53:46,331 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:46,333 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:53:46,333 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:46,333 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:46,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:46,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:46,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:46,334 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:53:46,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:46,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:46,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:46,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:46,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:46,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:46,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:53:46,337 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:53:46,337 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:46,338 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:46,338 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,338 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:46,340 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,340 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:46,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:46,340 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:46,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:46,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:46,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:46,341 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:46,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:46,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,342 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:46,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:46,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:46,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:46,345 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:46,345 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:46,345 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,345 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:46,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:46,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:46,346 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,346 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:46,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:46,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:46,346 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,346 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,346 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,346 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:46,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-21 13:53:46,346 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:46,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:46,347 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:46,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:46,388 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-21 13:53:46,447 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:46,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:46,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:46,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:53:46,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,455 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:46,455 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:46,456 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:53:46,456 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:53:46,456 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,456 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,458 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:46,458 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:46,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:46,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:46,458 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:46,458 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:46,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:46,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,459 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,459 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-21 13:53:46,459 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:46,460 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:53:46,460 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:46,460 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:53:46,460 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:46,460 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:46,460 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:46,461 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. started... 2023-11-21 13:53:46,461 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1747855f64ddd440c8691d3cb9a8c750 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:53:46,879 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ae623c03f23341ceb3a2aa20cd3a3164 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201ae623c03f23341ceb3a2aa20cd3a3164 2023-11-21 13:53:47,286 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/f36461c4bd93445aa38f649f2abae4ff 2023-11-21 13:53:47,293 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/f36461c4bd93445aa38f649f2abae4ff as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/f36461c4bd93445aa38f649f2abae4ff 2023-11-21 13:53:47,298 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/f36461c4bd93445aa38f649f2abae4ff, entries=1, sequenceid=13, filesize=4.9 K 2023-11-21 13:53:47,299 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1747855f64ddd440c8691d3cb9a8c750 in 838ms, sequenceid=13, compaction requested=true 2023-11-21 13:53:47,299 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1747855f64ddd440c8691d3cb9a8c750: 2023-11-21 13:53:47,299 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:47,299 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:47,300 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:47,300 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:47,300 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:53:47,300 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:53:47,388 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,388 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:47,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:47,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:47,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:47,388 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,388 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:47,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:47,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:47,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:47,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:47,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:53:47,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6951a92b[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:47,390 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:53:47,390 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,488 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,488 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:53:47,488 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:53:47,488 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:47,488 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:47,489 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:47,572 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:47,572 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:53:47,572 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:47,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:47,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:47,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:47,573 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:53:47,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:47,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:47,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:47,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:47,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:47,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:47,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:53:47,576 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:53:47,576 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:47,576 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:47,576 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,576 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:47,618 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,618 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:47,619 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:47,619 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:47,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:47,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,621 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:47,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:47,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:47,649 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:47,649 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:47,649 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,649 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:47,649 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:47,650 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:47,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:47,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:47,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:47,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-21 13:53:47,650 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:47,651 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,651 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,651 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,651 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:47,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:47,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:47,651 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:47,751 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:47,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:47,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:47,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:53:47,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,759 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:47,759 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:47,759 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:53:47,759 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:53:47,760 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,760 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,773 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:47,773 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:47,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:47,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:47,773 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:47,773 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:47,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,773 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:47,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,774 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,774 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-21 13:53:47,774 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:47,774 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:53:47,774 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:47,775 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:53:47,775 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:47,775 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:47,775 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:47,775 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. started... 2023-11-21 13:53:47,775 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1747855f64ddd440c8691d3cb9a8c750 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:53:48,189 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056348eb4e9163490cb7c2284be8cde2ce to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512056348eb4e9163490cb7c2284be8cde2ce 2023-11-21 13:53:48,595 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/212fa583e0b645ef9aaae423ed0b226e 2023-11-21 13:53:48,601 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/212fa583e0b645ef9aaae423ed0b226e as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/212fa583e0b645ef9aaae423ed0b226e 2023-11-21 13:53:48,607 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/212fa583e0b645ef9aaae423ed0b226e, entries=1, sequenceid=17, filesize=4.9 K 2023-11-21 13:53:48,608 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1747855f64ddd440c8691d3cb9a8c750 in 833ms, sequenceid=17, compaction requested=true 2023-11-21 13:53:48,608 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1747855f64ddd440c8691d3cb9a8c750: 2023-11-21 13:53:48,608 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:48,608 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:48,608 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:48,608 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:48,608 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:53:48,608 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:53:48,695 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:48,695 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:48,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:48,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:48,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:48,696 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:48,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:48,696 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:48,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:48,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:48,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:48,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:48,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:53:48,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17b1e7cb[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:48,697 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:53:48,697 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:48,757 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:48,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:48,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:48,757 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:53:48,757 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:53:48,757 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:48,757 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:48,757 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:48,934 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:53:48,934 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:48,934 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:48,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:48,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:48,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:48,934 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:53:48,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:48,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:48,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:48,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:53:48,937 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:53:48,937 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:48,937 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:48,937 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:48,937 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:49,003 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:49,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:49,004 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,004 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:49,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:49,004 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:49,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:49,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:49,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:49,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:49,008 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:49,049 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:49,049 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:49,049 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,049 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:49,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:49,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:49,049 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:49,049 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:49,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:49,050 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:49,050 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,050 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:49,050 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,051 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:49,051 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:49,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:49,151 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:49,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:49,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:49,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:53:49,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,159 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:49,159 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:49,159 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:53:49,160 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:53:49,160 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,160 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,203 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:49,203 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:49,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:49,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:49,204 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:49,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,204 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:49,204 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:49,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,205 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,205 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-21 13:53:49,205 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:49,205 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:53:49,205 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:49,206 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:53:49,206 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:49,206 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:49,206 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:49,206 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. started... 2023-11-21 13:53:49,206 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1747855f64ddd440c8691d3cb9a8c750 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:53:49,628 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228026495e780bd446683cdde1b652ef820 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228026495e780bd446683cdde1b652ef820 2023-11-21 13:53:50,041 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/2555864f9a0a437fba2b14bb6336111a 2023-11-21 13:53:50,048 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/2555864f9a0a437fba2b14bb6336111a as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/2555864f9a0a437fba2b14bb6336111a 2023-11-21 13:53:50,054 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/2555864f9a0a437fba2b14bb6336111a, entries=1, sequenceid=21, filesize=4.9 K 2023-11-21 13:53:50,055 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1747855f64ddd440c8691d3cb9a8c750 in 849ms, sequenceid=21, compaction requested=true 2023-11-21 13:53:50,055 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1747855f64ddd440c8691d3cb9a8c750: 2023-11-21 13:53:50,055 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:50,055 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:50,055 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:50,055 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:50,055 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:53:50,055 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:53:50,126 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,126 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:50,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:50,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:50,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:50,127 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,127 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:50,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:50,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:50,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:50,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:50,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:53:50,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21bd4669[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:50,128 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:53:50,128 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,203 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,203 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:53:50,203 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:53:50,203 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:50,203 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:50,204 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:50,218 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:50,218 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:53:50,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:50,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:50,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:50,219 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:50,219 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:53:50,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:50,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:50,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:50,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:50,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:50,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:50,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:53:50,222 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:53:50,222 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:50,222 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:50,222 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,222 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:50,234 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,234 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:50,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:50,234 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:50,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:50,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:50,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:50,235 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:50,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:50,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:50,236 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:50,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:50,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:50,250 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:50,250 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:50,250 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,250 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:50,250 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:50,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:50,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:50,250 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:50,251 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:50,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:50,251 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,251 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,251 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:50,251 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,251 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:50,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:50,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:50,351 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:50,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:50,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:50,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:53:50,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,358 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:50,358 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:50,359 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:53:50,359 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:53:50,360 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,360 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,361 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:50,361 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:50,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:50,362 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:50,362 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:50,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,363 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,363 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-21 13:53:50,363 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:50,363 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:53:50,363 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:50,364 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:53:50,364 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:50,364 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:50,364 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:50,364 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. started... 2023-11-21 13:53:50,364 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1747855f64ddd440c8691d3cb9a8c750 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:53:50,793 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311520ebb4719d41f19724230b8a3ae9ed to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512311520ebb4719d41f19724230b8a3ae9ed 2023-11-21 13:53:51,200 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/6e8f91190f1e48069ff9dd9e1cc4e354 2023-11-21 13:53:51,207 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/6e8f91190f1e48069ff9dd9e1cc4e354 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/6e8f91190f1e48069ff9dd9e1cc4e354 2023-11-21 13:53:51,214 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/6e8f91190f1e48069ff9dd9e1cc4e354, entries=1, sequenceid=25, filesize=4.9 K 2023-11-21 13:53:51,215 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1747855f64ddd440c8691d3cb9a8c750 in 851ms, sequenceid=25, compaction requested=true 2023-11-21 13:53:51,215 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1747855f64ddd440c8691d3cb9a8c750: 2023-11-21 13:53:51,215 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:51,215 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:51,215 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:51,215 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:51,215 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:53:51,215 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:53:51,217 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:51,217 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:51,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:51,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:51,217 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,217 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:51,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:51,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:51,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:51,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:51,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:53:51,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5da3cb2[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:51,219 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:53:51,219 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,220 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,220 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:53:51,221 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:53:51,221 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:51,221 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:51,221 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:51,222 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:51,222 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:53:51,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:51,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:51,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:51,222 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:51,222 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:53:51,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:51,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:51,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:51,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:51,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:51,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:51,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:53:51,225 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:53:51,225 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:51,225 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:51,225 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,225 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:51,228 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,228 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:51,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:51,228 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:51,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:51,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:51,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:51,229 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:51,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:51,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:51,230 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:51,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:51,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:51,233 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:51,233 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,233 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:51,233 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:51,233 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:51,233 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:51,233 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:51,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:51,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:51,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:51,234 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,234 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,234 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,234 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:51,234 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:51,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:51,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:51,334 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:51,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:51,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:51,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:53:51,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,343 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:51,343 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:51,343 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:53:51,343 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:53:51,344 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,344 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,345 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:51,345 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:51,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:51,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:51,346 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:51,346 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:51,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:51,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,347 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,347 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-21 13:53:51,348 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:51,348 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:53:51,348 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:51,348 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:53:51,348 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:51,348 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:51,348 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:51,348 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. started... 2023-11-21 13:53:51,349 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1747855f64ddd440c8691d3cb9a8c750 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:53:51,765 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101e90c54c45c2b41f096b086cd56e19280 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101e90c54c45c2b41f096b086cd56e19280 2023-11-21 13:53:52,171 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/c3bf2b3553484d579fcf668a3097513d 2023-11-21 13:53:52,179 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/c3bf2b3553484d579fcf668a3097513d as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/c3bf2b3553484d579fcf668a3097513d 2023-11-21 13:53:52,186 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/c3bf2b3553484d579fcf668a3097513d, entries=1, sequenceid=29, filesize=4.9 K 2023-11-21 13:53:52,187 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1747855f64ddd440c8691d3cb9a8c750 in 839ms, sequenceid=29, compaction requested=true 2023-11-21 13:53:52,187 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1747855f64ddd440c8691d3cb9a8c750: 2023-11-21 13:53:52,187 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:52,187 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:52,187 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:52,187 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,188 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:53:52,188 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:53:52,194 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,194 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:52,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:52,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:52,195 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,195 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:52,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:52,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:52,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:53:52,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61a6d5d3[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:52,197 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:53:52,197 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,199 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,199 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:53:52,199 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:53:52,199 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:52,199 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,199 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:52,200 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,200 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:53:52,201 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:52,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:52,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:52,201 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:53:52,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:52,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:52,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:52,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:52,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:53:52,206 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:53:52,206 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:52,206 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:52,206 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,206 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:52,208 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,208 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,208 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:52,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:52,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:52,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:52,209 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:52,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,210 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:52,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,216 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,216 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:52,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:52,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-21 13:53:52,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:52,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:52,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:52,216 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:52,216 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:52,216 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:52,217 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:52,216 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:52,217 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:52,217 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,217 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,217 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,217 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,317 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:52,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:52,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:52,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:53:52,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,326 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:52,327 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:52,327 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:53:52,327 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:53:52,327 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,328 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,329 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:52,329 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:52,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:52,330 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,330 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:52,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,330 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:52,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,331 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,331 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-21 13:53:52,331 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,331 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:53:52,331 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:52,331 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:53:52,331 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:52,331 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:52,331 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:52,332 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. started... 2023-11-21 13:53:52,332 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1747855f64ddd440c8691d3cb9a8c750 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:53:52,748 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fc727cf5ac184436a1222118d6d3e751 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103fc727cf5ac184436a1222118d6d3e751 2023-11-21 13:53:52,754 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/822cca4b37ff4f99a04bb48053b22588 2023-11-21 13:53:52,759 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/822cca4b37ff4f99a04bb48053b22588 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/822cca4b37ff4f99a04bb48053b22588 2023-11-21 13:53:52,765 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/822cca4b37ff4f99a04bb48053b22588, entries=1, sequenceid=33, filesize=4.9 K 2023-11-21 13:53:52,766 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1747855f64ddd440c8691d3cb9a8c750 in 434ms, sequenceid=33, compaction requested=true 2023-11-21 13:53:52,766 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1747855f64ddd440c8691d3cb9a8c750: 2023-11-21 13:53:52,766 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:52,766 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:52,766 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:52,766 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,766 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:53:52,766 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:53:52,768 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,768 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:52,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:52,769 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,769 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:52,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:52,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:52,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:52,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:53:52,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79b1e993[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:52,771 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:53:52,771 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,773 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,773 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:53:52,773 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:53:52,773 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:52,773 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,773 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:52,776 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:53:52,776 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,777 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:52,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:52,777 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:53:52,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:52,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:52,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:52,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:52,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:52,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:53:52,781 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:53:52,782 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:52,782 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:52,782 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,782 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:52,784 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,784 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:52,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:52,784 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:52,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:52,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:52,785 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:52,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:52,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,787 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:52,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,791 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,791 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,791 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,791 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,791 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,791 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,791 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,791 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:52,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-21 13:53:52,791 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:52,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:52,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:52,792 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:52,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:52,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:52,793 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:52,793 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:52,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:52,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:52,893 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:52,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:52,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:52,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:53:52,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,902 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:52,902 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:52,902 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:53:52,902 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:53:52,903 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,903 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,904 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:52,904 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:52,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:52,905 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:52,905 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:52,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:52,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,906 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,910 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-21 13:53:52,910 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:52,910 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:53:52,911 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:52,911 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:53:52,911 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:52,911 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:52,911 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:52,911 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. started... 2023-11-21 13:53:52,911 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1747855f64ddd440c8691d3cb9a8c750 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:53:53,334 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074465f5d8d4704db1a0f17de2ff661108 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509074465f5d8d4704db1a0f17de2ff661108 2023-11-21 13:53:53,740 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/cd5e6dbce60347cc985d21d4d162bc7e 2023-11-21 13:53:53,746 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/cd5e6dbce60347cc985d21d4d162bc7e as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/cd5e6dbce60347cc985d21d4d162bc7e 2023-11-21 13:53:53,751 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/cd5e6dbce60347cc985d21d4d162bc7e, entries=1, sequenceid=37, filesize=4.9 K 2023-11-21 13:53:53,752 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1747855f64ddd440c8691d3cb9a8c750 in 841ms, sequenceid=37, compaction requested=true 2023-11-21 13:53:53,752 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1747855f64ddd440c8691d3cb9a8c750: 2023-11-21 13:53:53,752 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:53,752 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:53,752 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:53,752 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:53,752 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:53:53,752 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:53:53,755 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:53,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:53,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:53,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:53,755 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:53,755 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,755 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:53,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:53,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:53,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:53,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:53:53,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32f476c2[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:53,757 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:53:53,757 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,758 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,758 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:53:53,758 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:53:53,758 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:53,758 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:53,759 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:53,760 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:53,760 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:53:53,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:53,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:53,760 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:53,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:53,760 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:53:53,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:53,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:53,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:53,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:53,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:53,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:53,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:53:53,763 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:53:53,763 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:53,763 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:53,763 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,763 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:53,765 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,765 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:53,765 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:53,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:53,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:53,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:53,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:53,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,766 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:53,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:53,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:53,767 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:53,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:53,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:53,774 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:53,774 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:53,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:53,774 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,774 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:53,774 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:53,774 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:53,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:53,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:53,775 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:53,775 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,775 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,775 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,775 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:53,775 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:53,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:53,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:53,875 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:53,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:53,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:53,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:53:53,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,882 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:53,883 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:53,883 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:53:53,883 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:53:53,884 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,884 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,885 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:53,885 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:53,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:53,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:53,886 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:53,886 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:53,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:53,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,887 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,887 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-21 13:53:53,887 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:53,887 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:53:53,887 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:53,888 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:53:53,888 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:53,889 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:53,889 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:53,889 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. started... 2023-11-21 13:53:53,889 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1747855f64ddd440c8691d3cb9a8c750 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:53:54,304 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120407a5b9f34f54138bced0d75601c38df to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120407a5b9f34f54138bced0d75601c38df 2023-11-21 13:53:54,711 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/ab26f42ac54f42f58275b0f964443510 2023-11-21 13:53:54,717 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/ab26f42ac54f42f58275b0f964443510 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/ab26f42ac54f42f58275b0f964443510 2023-11-21 13:53:54,723 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/ab26f42ac54f42f58275b0f964443510, entries=1, sequenceid=41, filesize=4.9 K 2023-11-21 13:53:54,724 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1747855f64ddd440c8691d3cb9a8c750 in 835ms, sequenceid=41, compaction requested=true 2023-11-21 13:53:54,724 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1747855f64ddd440c8691d3cb9a8c750: 2023-11-21 13:53:54,724 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:54,724 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:54,724 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:54,724 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:54,724 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:53:54,724 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:53:54,726 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:54,726 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:54,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:54,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:54,726 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,726 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:54,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:54,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:54,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:54,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:54,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:53:54,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@661fe382[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:54,728 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:53:54,728 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,729 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,730 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:53:54,730 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:53:54,730 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:54,730 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:54,730 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:54,732 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:54,732 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:53:54,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:54,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:54,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:54,732 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:54,732 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:53:54,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:54,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:54,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:54,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:54,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:54,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:54,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:53:54,735 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:53:54,735 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:54,735 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:54,735 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,736 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:54,737 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,737 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:54,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:54,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,737 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:54,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:54,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:54,738 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:54,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:54,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:54,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:54,739 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:54,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:54,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:54,742 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:54,742 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,742 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:54,742 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:54,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:54,742 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:54,742 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-21 13:53:54,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:54,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:54,744 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:54,744 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,744 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,744 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,744 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:54,744 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:54,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:54,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:54,844 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:54,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:54,846 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43219] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-21 13:53:54,848 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-21 13:53:54,849 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-21 13:53:54,850 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:53:54,850 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700575434850 2023-11-21 13:53:54,851 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-21 13:53:54,852 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-21 13:53:54,852 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-21 13:53:54,854 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] zookeeper.ReadOnlyZKClient(139): Connect 0x0790c8fc to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:53:54,858 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b6cd9d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:53:54,858 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-21 13:53:55,690 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032b7093a7d41147db9844b52bfb471da4 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601032b7093a7d41147db9844b52bfb471da4 2023-11-21 13:53:55,691 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-21 13:53:55,703 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:53:55,704 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:38492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:53:55,711 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-21 13:53:55,712 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:43676, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-21 13:53:55,721 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/30618a9f2a104006b5558844274d20d6 first=Optional[r5] last=Optional[r6] 2023-11-21 13:53:55,722 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/30618a9f2a104006b5558844274d20d6}] 2023-11-21 13:53:55,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/30618a9f2a104006b5558844274d20d6 for inclusion in 1747855f64ddd440c8691d3cb9a8c750/family1 2023-11-21 13:53:55,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-21 13:53:55,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:53:55,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 1747855f64ddd440c8691d3cb9a8c750: 2023-11-21 13:53:55,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/30618a9f2a104006b5558844274d20d6 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1u72prg0j2u01couptgu1nu7n5klvja33n579u8oj96c3tlachrbatd47ehrs29g/family1/30618a9f2a104006b5558844274d20d6 2023-11-21 13:53:55,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1u72prg0j2u01couptgu1nu7n5klvja33n579u8oj96c3tlachrbatd47ehrs29g/family1/30618a9f2a104006b5558844274d20d6 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/6e7a73abcd944a7593f4bad1fa37a3c2_SeqId_44_ 2023-11-21 13:53:55,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1u72prg0j2u01couptgu1nu7n5klvja33n579u8oj96c3tlachrbatd47ehrs29g/family1/30618a9f2a104006b5558844274d20d6 into 1747855f64ddd440c8691d3cb9a8c750/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/6e7a73abcd944a7593f4bad1fa37a3c2_SeqId_44_ - updating store file list. 2023-11-21 13:53:55,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/6e7a73abcd944a7593f4bad1fa37a3c2_SeqId_44_ into 1747855f64ddd440c8691d3cb9a8c750/family1 2023-11-21 13:53:55,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1u72prg0j2u01couptgu1nu7n5klvja33n579u8oj96c3tlachrbatd47ehrs29g/family1/30618a9f2a104006b5558844274d20d6 into 1747855f64ddd440c8691d3cb9a8c750/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/6e7a73abcd944a7593f4bad1fa37a3c2_SeqId_44_) 2023-11-21 13:53:55,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1u72prg0j2u01couptgu1nu7n5klvja33n579u8oj96c3tlachrbatd47ehrs29g/family1/30618a9f2a104006b5558844274d20d6 2023-11-21 13:53:55,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-21 13:53:55,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-21 13:53:55,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(1912): 1747855f64ddd440c8691d3cb9a8c750/family1 is initiating minor compaction 2023-11-21 13:53:55,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@51773d0d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:53:55,743 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1747855f64ddd440c8691d3cb9a8c750/family1 in testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:55,744 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/802559530b7f40fa897a2fac04d1a2c2, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/f36461c4bd93445aa38f649f2abae4ff, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/212fa583e0b645ef9aaae423ed0b226e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/2555864f9a0a437fba2b14bb6336111a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/6e8f91190f1e48069ff9dd9e1cc4e354, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/c3bf2b3553484d579fcf668a3097513d, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/822cca4b37ff4f99a04bb48053b22588, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/cd5e6dbce60347cc985d21d4d162bc7e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/ab26f42ac54f42f58275b0f964443510, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/6e7a73abcd944a7593f4bad1fa37a3c2_SeqId_44_] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp, totalSize=49.7 K 2023-11-21 13:53:55,744 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 802559530b7f40fa897a2fac04d1a2c2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-21 13:53:55,744 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting f36461c4bd93445aa38f649f2abae4ff, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-21 13:53:55,744 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 212fa583e0b645ef9aaae423ed0b226e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-21 13:53:55,744 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 2555864f9a0a437fba2b14bb6336111a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-21 13:53:55,744 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 6e8f91190f1e48069ff9dd9e1cc4e354, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-21 13:53:55,744 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting c3bf2b3553484d579fcf668a3097513d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-21 13:53:55,744 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 822cca4b37ff4f99a04bb48053b22588, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-21 13:53:55,744 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting cd5e6dbce60347cc985d21d4d162bc7e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-21 13:53:55,744 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting ab26f42ac54f42f58275b0f964443510, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-21 13:53:55,744 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 6e7a73abcd944a7593f4bad1fa37a3c2_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-21 13:53:55,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-21 13:53:55,747 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:53:55,748 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101e90c54c45c2b41f096b086cd56e19280 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101e90c54c45c2b41f096b086cd56e19280 2023-11-21 13:53:55,750 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103fc727cf5ac184436a1222118d6d3e751 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103fc727cf5ac184436a1222118d6d3e751 2023-11-21 13:53:55,750 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-21 13:53:55,750 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-21 13:53:55,751 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-21 13:53:55,751 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-21 13:53:55,799 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1747855f64ddd440c8691d3cb9a8c750#family1#compaction#22 average throughput is 0.27 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:53:56,217 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/8e95149171a64618a846a95e73d85bf7 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/8e95149171a64618a846a95e73d85bf7 2023-11-21 13:53:56,223 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1747855f64ddd440c8691d3cb9a8c750/family1 of 1747855f64ddd440c8691d3cb9a8c750 into 8e95149171a64618a846a95e73d85bf7(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:53:56,223 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1747855f64ddd440c8691d3cb9a8c750: 2023-11-21 13:53:56,223 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1700574835743; duration=0sec 2023-11-21 13:53:56,223 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:53:56,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/802559530b7f40fa897a2fac04d1a2c2, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/f36461c4bd93445aa38f649f2abae4ff, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/212fa583e0b645ef9aaae423ed0b226e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/2555864f9a0a437fba2b14bb6336111a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/6e8f91190f1e48069ff9dd9e1cc4e354, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/c3bf2b3553484d579fcf668a3097513d, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/822cca4b37ff4f99a04bb48053b22588, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/cd5e6dbce60347cc985d21d4d162bc7e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/ab26f42ac54f42f58275b0f964443510, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/6e7a73abcd944a7593f4bad1fa37a3c2_SeqId_44_] to archive 2023-11-21 13:53:56,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:53:56,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/802559530b7f40fa897a2fac04d1a2c2 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/802559530b7f40fa897a2fac04d1a2c2 2023-11-21 13:53:56,313 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/f36461c4bd93445aa38f649f2abae4ff to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/f36461c4bd93445aa38f649f2abae4ff 2023-11-21 13:53:56,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/212fa583e0b645ef9aaae423ed0b226e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/212fa583e0b645ef9aaae423ed0b226e 2023-11-21 13:53:56,316 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/2555864f9a0a437fba2b14bb6336111a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/2555864f9a0a437fba2b14bb6336111a 2023-11-21 13:53:56,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/6e8f91190f1e48069ff9dd9e1cc4e354 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/6e8f91190f1e48069ff9dd9e1cc4e354 2023-11-21 13:53:56,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/c3bf2b3553484d579fcf668a3097513d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/c3bf2b3553484d579fcf668a3097513d 2023-11-21 13:53:56,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/822cca4b37ff4f99a04bb48053b22588 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/822cca4b37ff4f99a04bb48053b22588 2023-11-21 13:53:56,321 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/cd5e6dbce60347cc985d21d4d162bc7e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/cd5e6dbce60347cc985d21d4d162bc7e 2023-11-21 13:53:56,322 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/ab26f42ac54f42f58275b0f964443510 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/ab26f42ac54f42f58275b0f964443510 2023-11-21 13:53:56,323 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/6e7a73abcd944a7593f4bad1fa37a3c2_SeqId_44_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/6e7a73abcd944a7593f4bad1fa37a3c2_SeqId_44_ 2023-11-21 13:53:56,617 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d2b4fd7540b84e7c905c2122ab170af8 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231d2b4fd7540b84e7c905c2122ab170af8 2023-11-21 13:53:56,618 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-21 13:53:56,644 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/8ff6af39f3894cf79a587d33878301f2 first=Optional[r1] last=Optional[r4] 2023-11-21 13:53:56,644 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/8ff6af39f3894cf79a587d33878301f2}] 2023-11-21 13:53:56,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/8ff6af39f3894cf79a587d33878301f2 for inclusion in 1747855f64ddd440c8691d3cb9a8c750/family1 2023-11-21 13:53:56,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-21 13:53:56,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:53:56,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 1747855f64ddd440c8691d3cb9a8c750: 2023-11-21 13:53:56,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/8ff6af39f3894cf79a587d33878301f2 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__a5aemqerggk5d8r437gd29ge0uu23hru8rt21c3n3lu4vhknbgsbmnq60799cabf/family1/8ff6af39f3894cf79a587d33878301f2 2023-11-21 13:53:56,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__a5aemqerggk5d8r437gd29ge0uu23hru8rt21c3n3lu4vhknbgsbmnq60799cabf/family1/8ff6af39f3894cf79a587d33878301f2 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/b4f0e9be866849c984d6108457c6ad68_SeqId_47_ 2023-11-21 13:53:56,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__a5aemqerggk5d8r437gd29ge0uu23hru8rt21c3n3lu4vhknbgsbmnq60799cabf/family1/8ff6af39f3894cf79a587d33878301f2 into 1747855f64ddd440c8691d3cb9a8c750/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/b4f0e9be866849c984d6108457c6ad68_SeqId_47_ - updating store file list. 2023-11-21 13:53:56,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/b4f0e9be866849c984d6108457c6ad68_SeqId_47_ into 1747855f64ddd440c8691d3cb9a8c750/family1 2023-11-21 13:53:56,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__a5aemqerggk5d8r437gd29ge0uu23hru8rt21c3n3lu4vhknbgsbmnq60799cabf/family1/8ff6af39f3894cf79a587d33878301f2 into 1747855f64ddd440c8691d3cb9a8c750/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/b4f0e9be866849c984d6108457c6ad68_SeqId_47_) 2023-11-21 13:53:56,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__a5aemqerggk5d8r437gd29ge0uu23hru8rt21c3n3lu4vhknbgsbmnq60799cabf/family1/8ff6af39f3894cf79a587d33878301f2 2023-11-21 13:53:56,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-21 13:53:56,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-21 13:53:56,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(1912): 1747855f64ddd440c8691d3cb9a8c750/family1 is initiating minor compaction (all files) 2023-11-21 13:53:56,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4db0b661; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:53:56,661 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1747855f64ddd440c8691d3cb9a8c750/family1 in testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:53:56,661 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/708476994d334a4fbe6e4d0db8b4daac, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/8e95149171a64618a846a95e73d85bf7, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/b4f0e9be866849c984d6108457c6ad68_SeqId_47_] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp, totalSize=178.1 K 2023-11-21 13:53:56,661 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 708476994d334a4fbe6e4d0db8b4daac, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878827509 2023-11-21 13:53:56,662 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 8e95149171a64618a846a95e73d85bf7, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621227509 2023-11-21 13:53:56,662 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting b4f0e9be866849c984d6108457c6ad68_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965227509 2023-11-21 13:53:56,663 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-21 13:53:56,663 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:53:56,665 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201ae623c03f23341ceb3a2aa20cd3a3164 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201ae623c03f23341ceb3a2aa20cd3a3164 2023-11-21 13:53:56,667 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512056348eb4e9163490cb7c2284be8cde2ce to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512056348eb4e9163490cb7c2284be8cde2ce 2023-11-21 13:53:56,668 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228026495e780bd446683cdde1b652ef820 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228026495e780bd446683cdde1b652ef820 2023-11-21 13:53:56,670 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512311520ebb4719d41f19724230b8a3ae9ed to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512311520ebb4719d41f19724230b8a3ae9ed 2023-11-21 13:53:56,670 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-21 13:53:56,670 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-21 13:53:56,671 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-21 13:53:56,671 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-21 13:53:56,685 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1747855f64ddd440c8691d3cb9a8c750#family1#compaction#23 average throughput is 11.97 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:53:56,714 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511304ec47c95d12d4b8b910ed94e306aec52 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511304ec47c95d12d4b8b910ed94e306aec52 2023-11-21 13:53:56,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-21 13:53:56,745 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b58bb086873c46819c4a0d0590431828 first=Optional[r00] last=Optional[r8] 2023-11-21 13:53:56,745 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b58bb086873c46819c4a0d0590431828}] 2023-11-21 13:53:56,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b58bb086873c46819c4a0d0590431828 for inclusion in 1747855f64ddd440c8691d3cb9a8c750/family1 2023-11-21 13:53:56,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-21 13:53:56,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:53:56,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 1747855f64ddd440c8691d3cb9a8c750: 2023-11-21 13:53:56,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b58bb086873c46819c4a0d0590431828 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__mnce46irolb8tji0ffforfsi1doksokikqn9h325736bifvquqcfs5efhlke77ju/family1/b58bb086873c46819c4a0d0590431828 2023-11-21 13:53:56,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__mnce46irolb8tji0ffforfsi1doksokikqn9h325736bifvquqcfs5efhlke77ju/family1/b58bb086873c46819c4a0d0590431828 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/59d8e24ff6ba43ed8a7b32aff0b57950_SeqId_49_ 2023-11-21 13:53:56,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__mnce46irolb8tji0ffforfsi1doksokikqn9h325736bifvquqcfs5efhlke77ju/family1/b58bb086873c46819c4a0d0590431828 into 1747855f64ddd440c8691d3cb9a8c750/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/59d8e24ff6ba43ed8a7b32aff0b57950_SeqId_49_ - updating store file list. 2023-11-21 13:53:56,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/59d8e24ff6ba43ed8a7b32aff0b57950_SeqId_49_ into 1747855f64ddd440c8691d3cb9a8c750/family1 2023-11-21 13:53:56,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__mnce46irolb8tji0ffforfsi1doksokikqn9h325736bifvquqcfs5efhlke77ju/family1/b58bb086873c46819c4a0d0590431828 into 1747855f64ddd440c8691d3cb9a8c750/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/59d8e24ff6ba43ed8a7b32aff0b57950_SeqId_49_) 2023-11-21 13:53:56,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__mnce46irolb8tji0ffforfsi1doksokikqn9h325736bifvquqcfs5efhlke77ju/family1/b58bb086873c46819c4a0d0590431828 2023-11-21 13:53:56,762 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-21 13:53:56,762 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:53:56,764 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120407a5b9f34f54138bced0d75601c38df to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120407a5b9f34f54138bced0d75601c38df 2023-11-21 13:53:56,765 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112889e6eacf2dda4fb296a53b595222fbec to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112889e6eacf2dda4fb296a53b595222fbec 2023-11-21 13:53:56,766 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113091970b1ee05f484b8d78867a6ba3f9d7 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113091970b1ee05f484b8d78867a6ba3f9d7 2023-11-21 13:53:56,767 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-21 13:53:56,767 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-21 13:53:56,767 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-21 13:53:56,767 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-21 13:53:56,767 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-21 13:53:56,767 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-21 13:53:56,767 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:53:56,768 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-21 13:53:56,770 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.9220 sec 2023-11-21 13:53:56,871 INFO [Listener at localhost/35077] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=263 (was 250) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52369@0x0790c8fc-SendThread(127.0.0.1:52369) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:37892 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:37888 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-1622902389-172.31.2.20-1700574799715:blk_1073741898_1074, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:37964 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47d5a200-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52369@0x0790c8fc sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1332557819.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47d5a200-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:37876 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-1622902389-172.31.2.20-1700574799715:blk_1073741898_1074 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:38080 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_663891427_17 at /127.0.0.1:38072 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:37990 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_663891427_17 at /127.0.0.1:38094 [Receiving block BP-1622902389-172.31.2.20-1700574799715:blk_1073741898_1074] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:37960 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:37938 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:37980 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33b0120e-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/cluster_95986160-9be6-b7e5-6f91-17727d35080f/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:37932 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47d5a200-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:37856 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:52369@0x0790c8fc-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:37986 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:37920 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/cluster_95986160-9be6-b7e5-6f91-17727d35080f/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/a8586fdf7de740dfb98a9a673943a422 block BP-1622902389-172.31.2.20-1700574799715:blk_1073741898_1074 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:38020 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:37906 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47d5a200-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231babd5948705946299fad1da6f1afac7f java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: hconnection-0x47d5a200-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47d5a200-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1696422579_17 at /127.0.0.1:37822 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47d5a200-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=644 (was 620) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=306 (was 292) - SystemLoadAverage LEAK? -, ProcessCount=174 (was 174), AvailableMemoryMB=7178 (was 7340) 2023-11-21 13:53:56,884 INFO [Listener at localhost/35077] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=263, OpenFileDescriptor=644, MaxFileDescriptor=60000, SystemLoadAverage=306, ProcessCount=174, AvailableMemoryMB=7177 2023-11-21 13:53:56,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-21 13:53:56,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:56,888 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-21 13:53:56,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-21 13:53:56,889 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-21 13:53:56,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-21 13:53:56,891 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e 2023-11-21 13:53:56,891 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e empty. 2023-11-21 13:53:56,892 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e 2023-11-21 13:53:56,892 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-21 13:53:56,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-21 13:53:57,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-21 13:53:57,301 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-21 13:53:57,302 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => a9b41c012f2bce1737bed7cb5c4c9b7e, NAME => 'testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:53:57,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-21 13:53:57,510 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/.tmp/family1/a8586fdf7de740dfb98a9a673943a422 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/a8586fdf7de740dfb98a9a673943a422 2023-11-21 13:53:57,515 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1747855f64ddd440c8691d3cb9a8c750/family1 of 1747855f64ddd440c8691d3cb9a8c750 into a8586fdf7de740dfb98a9a673943a422(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:53:57,515 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1747855f64ddd440c8691d3cb9a8c750: 2023-11-21 13:53:57,516 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1700574836660; duration=0sec 2023-11-21 13:53:57,516 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:53:57,595 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/708476994d334a4fbe6e4d0db8b4daac, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/8e95149171a64618a846a95e73d85bf7, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/b4f0e9be866849c984d6108457c6ad68_SeqId_47_] to archive 2023-11-21 13:53:57,596 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:53:57,598 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/708476994d334a4fbe6e4d0db8b4daac to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/708476994d334a4fbe6e4d0db8b4daac 2023-11-21 13:53:57,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/8e95149171a64618a846a95e73d85bf7 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/8e95149171a64618a846a95e73d85bf7 2023-11-21 13:53:57,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/b4f0e9be866849c984d6108457c6ad68_SeqId_47_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/family1/b4f0e9be866849c984d6108457c6ad68_SeqId_47_ 2023-11-21 13:53:57,709 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:53:57,709 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing a9b41c012f2bce1737bed7cb5c4c9b7e, disabling compactions & flushes 2023-11-21 13:53:57,709 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:53:57,709 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:53:57,709 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. after waiting 0 ms 2023-11-21 13:53:57,709 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:53:57,709 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:53:57,709 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for a9b41c012f2bce1737bed7cb5c4c9b7e: 2023-11-21 13:53:57,712 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-21 13:53:57,713 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700574837713"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574837713"}]},"ts":"1700574837713"} 2023-11-21 13:53:57,715 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-21 13:53:57,716 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-21 13:53:57,716 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574837716"}]},"ts":"1700574837716"} 2023-11-21 13:53:57,718 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-21 13:53:57,723 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=a9b41c012f2bce1737bed7cb5c4c9b7e, ASSIGN}] 2023-11-21 13:53:57,724 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=a9b41c012f2bce1737bed7cb5c4c9b7e, ASSIGN 2023-11-21 13:53:57,725 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=a9b41c012f2bce1737bed7cb5c4c9b7e, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:53:57,876 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=a9b41c012f2bce1737bed7cb5c4c9b7e, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:57,876 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700574837876"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574837876"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574837876"}]},"ts":"1700574837876"} 2023-11-21 13:53:57,878 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure a9b41c012f2bce1737bed7cb5c4c9b7e, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:53:57,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-21 13:53:58,031 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:58,034 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:53:58,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a9b41c012f2bce1737bed7cb5c4c9b7e, NAME => 'testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e.', STARTKEY => '', ENDKEY => ''} 2023-11-21 13:53:58,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy a9b41c012f2bce1737bed7cb5c4c9b7e 2023-11-21 13:53:58,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:53:58,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for a9b41c012f2bce1737bed7cb5c4c9b7e 2023-11-21 13:53:58,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for a9b41c012f2bce1737bed7cb5c4c9b7e 2023-11-21 13:53:58,036 INFO [StoreOpener-a9b41c012f2bce1737bed7cb5c4c9b7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a9b41c012f2bce1737bed7cb5c4c9b7e 2023-11-21 13:53:58,037 DEBUG [StoreOpener-a9b41c012f2bce1737bed7cb5c4c9b7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1 2023-11-21 13:53:58,037 DEBUG [StoreOpener-a9b41c012f2bce1737bed7cb5c4c9b7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1 2023-11-21 13:53:58,038 INFO [StoreOpener-a9b41c012f2bce1737bed7cb5c4c9b7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a9b41c012f2bce1737bed7cb5c4c9b7e columnFamilyName family1 2023-11-21 13:53:58,039 INFO [StoreOpener-a9b41c012f2bce1737bed7cb5c4c9b7e-1] regionserver.HStore(310): Store=a9b41c012f2bce1737bed7cb5c4c9b7e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:53:58,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e 2023-11-21 13:53:58,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e 2023-11-21 13:53:58,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for a9b41c012f2bce1737bed7cb5c4c9b7e 2023-11-21 13:53:58,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:53:58,045 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened a9b41c012f2bce1737bed7cb5c4c9b7e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59945301, jitterRate=-0.1067454069852829}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-21 13:53:58,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for a9b41c012f2bce1737bed7cb5c4c9b7e: 2023-11-21 13:53:58,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e., pid=25, masterSystemTime=1700574838031 2023-11-21 13:53:58,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:53:58,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:53:58,048 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=a9b41c012f2bce1737bed7cb5c4c9b7e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:58,048 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700574838048"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574838048"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574838048"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574838048"}]},"ts":"1700574838048"} 2023-11-21 13:53:58,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=25, resume processing ppid=24 2023-11-21 13:53:58,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure a9b41c012f2bce1737bed7cb5c4c9b7e, server=jenkins-hbase6.apache.org,46365,1700574804408 in 172 msec 2023-11-21 13:53:58,054 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=24, resume processing ppid=23 2023-11-21 13:53:58,054 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=a9b41c012f2bce1737bed7cb5c4c9b7e, ASSIGN in 329 msec 2023-11-21 13:53:58,054 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-21 13:53:58,054 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574838054"}]},"ts":"1700574838054"} 2023-11-21 13:53:58,056 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-21 13:53:58,059 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-21 13:53:58,060 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1730 sec 2023-11-21 13:53:58,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-21 13:53:58,995 INFO [Listener at localhost/35077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-21 13:53:59,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:53:59,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,022 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:53:59,022 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:59,022 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:53:59,022 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:53:59,022 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,022 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,024 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:59,024 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:59,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:59,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:59,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,025 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:59,025 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:53:59,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:53:59,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,026 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,026 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:53:59,026 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:53:59,026 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:53:59,030 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:53:59,030 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:53:59,030 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:53:59,030 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. started... 2023-11-21 13:53:59,031 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a9b41c012f2bce1737bed7cb5c4c9b7e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-21 13:53:59,456 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a281677983424482afd74b81b1e61d88 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130a281677983424482afd74b81b1e61d88 2023-11-21 13:53:59,861 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/19d9e528a3eb4a96a72f996758ab7824 2023-11-21 13:53:59,867 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/19d9e528a3eb4a96a72f996758ab7824 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/19d9e528a3eb4a96a72f996758ab7824 2023-11-21 13:53:59,871 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/19d9e528a3eb4a96a72f996758ab7824, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-21 13:53:59,872 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for a9b41c012f2bce1737bed7cb5c4c9b7e in 841ms, sequenceid=5, compaction requested=false 2023-11-21 13:53:59,873 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:53:59,873 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a9b41c012f2bce1737bed7cb5c4c9b7e: 2023-11-21 13:53:59,873 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:53:59,873 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:53:59,873 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:53:59,873 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:59,874 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:53:59,874 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:53:59,875 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:59,875 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:59,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:59,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:59,876 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,876 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:53:59,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:59,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:59,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:59,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:59,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:53:59,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3140badf[Count = 0] remaining members to acquire global barrier 2023-11-21 13:53:59,877 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:53:59,877 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,880 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,880 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:53:59,880 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:53:59,880 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:53:59,880 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:59,880 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:53:59,882 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:59,882 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:53:59,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:59,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:59,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:59,882 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:59,882 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:53:59,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:59,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:59,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:59,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:59,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:59,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:53:59,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:53:59,884 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:53:59,885 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:53:59,885 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:53:59,885 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,885 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:53:59,887 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,887 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:53:59,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:53:59,887 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:59,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:59,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:59,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:53:59,887 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:59,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:53:59,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,889 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:59,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:59,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:53:59,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:59,891 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:59,891 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:53:59,891 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:53:59,891 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:53:59,892 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-21 13:53:59,891 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:53:59,891 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:53:59,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:53:59,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:53:59,892 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:53:59,892 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,892 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,892 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:53:59,892 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:53:59,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:53:59,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:53:59,892 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:53:59,992 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:53:59,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:53:59,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:00,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:00,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,000 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:54:00,000 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:00,000 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:00,000 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:00,000 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,000 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,003 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,003 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:00,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:00,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:00,003 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,004 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:00,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,004 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:00,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,005 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,005 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-21 13:54:00,005 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,005 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:00,005 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:00,005 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:00,005 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:00,005 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:00,005 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:00,005 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. started... 2023-11-21 13:54:00,005 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a9b41c012f2bce1737bed7cb5c4c9b7e 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-21 13:54:00,419 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b27dded64e644fef81820fa4168fde5f to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128b27dded64e644fef81820fa4168fde5f 2023-11-21 13:54:00,825 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/bb9ce06302e0487dbe27ecc0d64556ed 2023-11-21 13:54:00,831 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/bb9ce06302e0487dbe27ecc0d64556ed as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/bb9ce06302e0487dbe27ecc0d64556ed 2023-11-21 13:54:00,836 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/bb9ce06302e0487dbe27ecc0d64556ed, entries=1, sequenceid=9, filesize=5.0 K 2023-11-21 13:54:00,837 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for a9b41c012f2bce1737bed7cb5c4c9b7e in 832ms, sequenceid=9, compaction requested=false 2023-11-21 13:54:00,837 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a9b41c012f2bce1737bed7cb5c4c9b7e: 2023-11-21 13:54:00,837 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:00,837 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:00,837 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:00,837 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,837 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:00,837 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:00,843 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,843 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:00,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:00,844 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:00,844 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:00,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:00,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:00,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:00,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47cb2015[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:00,845 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:00,845 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,847 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,847 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:00,847 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:00,847 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:00,847 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,847 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:00,850 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,850 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:00,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:00,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:00,850 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:00,851 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:00,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:00,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:00,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:00,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:00,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:00,853 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:00,853 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:00,853 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:00,853 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,853 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:00,855 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,855 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:00,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,855 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:00,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:00,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:00,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:00,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:00,855 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:00,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,857 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:00,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,859 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,860 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:00,860 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:00,860 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:00,860 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,860 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:00,860 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,860 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,860 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,860 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:54:00,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:00,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:00,860 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-21 13:54:00,860 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:00,860 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:00,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:00,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:00,961 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:00,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:00,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:00,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:00,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,967 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:54:00,967 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:00,967 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:00,967 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:00,968 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,968 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,969 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:00,969 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:00,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:00,969 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:00,970 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:00,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:00,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,970 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,970 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-21 13:54:00,971 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:00,971 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:00,971 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:00,971 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:00,971 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:00,971 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:00,971 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:00,971 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. started... 2023-11-21 13:54:00,971 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a9b41c012f2bce1737bed7cb5c4c9b7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:01,387 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201cf3731eae43f43fbaba621f53fe68d43 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201cf3731eae43f43fbaba621f53fe68d43 2023-11-21 13:54:01,793 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/ca0eb1d6e31942999161646f8fc2a619 2023-11-21 13:54:01,799 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/ca0eb1d6e31942999161646f8fc2a619 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/ca0eb1d6e31942999161646f8fc2a619 2023-11-21 13:54:01,804 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/ca0eb1d6e31942999161646f8fc2a619, entries=1, sequenceid=13, filesize=4.9 K 2023-11-21 13:54:01,805 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a9b41c012f2bce1737bed7cb5c4c9b7e in 834ms, sequenceid=13, compaction requested=true 2023-11-21 13:54:01,805 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a9b41c012f2bce1737bed7cb5c4c9b7e: 2023-11-21 13:54:01,805 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:01,805 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:01,805 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:01,805 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:01,805 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:01,805 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:01,809 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:01,809 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:01,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:01,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:01,809 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,810 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:01,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:01,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:01,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:01,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:01,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:01,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56181c48[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:01,811 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:01,811 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,812 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,812 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:01,812 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:01,813 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:01,813 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:01,813 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:01,814 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:01,814 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:01,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:01,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:01,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:01,814 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:01,814 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:01,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:01,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:01,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:01,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:01,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:01,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:01,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:01,817 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:01,817 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:01,817 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:01,817 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,817 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:01,819 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,819 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:01,819 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:01,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:01,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,819 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:01,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:01,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:01,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:01,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:01,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,820 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:01,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:01,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:01,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:01,823 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:01,824 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,824 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:01,824 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:01,824 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:01,824 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:01,824 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:01,824 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:54:01,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:01,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-21 13:54:01,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:01,824 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,824 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,824 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:01,824 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:01,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:01,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:01,925 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:01,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:01,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:01,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:01,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,932 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:54:01,932 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:01,932 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:01,932 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:01,933 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,933 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,934 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:01,934 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:01,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:01,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:01,935 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:01,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,935 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:01,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:01,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,936 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,936 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-21 13:54:01,936 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:01,936 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:01,936 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:01,936 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:01,936 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:01,936 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:01,936 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:01,936 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. started... 2023-11-21 13:54:01,936 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a9b41c012f2bce1737bed7cb5c4c9b7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:02,353 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051d9f86bd3d4c4d2580f9636a8b2ab476 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512051d9f86bd3d4c4d2580f9636a8b2ab476 2023-11-21 13:54:02,760 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/e895387fae014092a6d27b337ff9407a 2023-11-21 13:54:02,765 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/e895387fae014092a6d27b337ff9407a as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/e895387fae014092a6d27b337ff9407a 2023-11-21 13:54:02,770 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/e895387fae014092a6d27b337ff9407a, entries=1, sequenceid=17, filesize=4.9 K 2023-11-21 13:54:02,771 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a9b41c012f2bce1737bed7cb5c4c9b7e in 835ms, sequenceid=17, compaction requested=true 2023-11-21 13:54:02,771 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a9b41c012f2bce1737bed7cb5c4c9b7e: 2023-11-21 13:54:02,771 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:02,771 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:02,771 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:02,771 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:02,771 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:02,771 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:02,773 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:02,773 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:02,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:02,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:02,774 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,774 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:02,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:02,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:02,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:02,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:02,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f02e6fa[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:02,775 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:02,775 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,777 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,777 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:02,777 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:02,777 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:02,777 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:02,777 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:02,779 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:02,779 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:02,780 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:02,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:02,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:02,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:02,780 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:02,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:02,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:02,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:02,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:02,782 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:02,782 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:02,782 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:02,782 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,782 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:02,785 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,785 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:02,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:02,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,785 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:02,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:02,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:02,785 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:02,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:02,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:02,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:02,787 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:02,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:02,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:02,792 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:02,793 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,793 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:02,793 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:54:02,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:02,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:02,793 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:02,793 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:02,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:02,793 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:02,793 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,793 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,793 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:02,793 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,793 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:02,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:02,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:02,893 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:02,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:02,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:02,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:02,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,901 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:54:02,901 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:02,901 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:02,901 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:02,901 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,901 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,903 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:02,903 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:02,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:02,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:02,903 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:02,903 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:02,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:02,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,904 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,904 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-21 13:54:02,904 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:02,904 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:02,904 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:02,905 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:02,905 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:02,905 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:02,905 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:02,905 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. started... 2023-11-21 13:54:02,905 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a9b41c012f2bce1737bed7cb5c4c9b7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:03,318 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228e47bb49ada374dc3bab2c5230595d747 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228e47bb49ada374dc3bab2c5230595d747 2023-11-21 13:54:03,568 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-21 13:54:03,724 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/bc73cd46dafc42b99b1af2c544c86ad7 2023-11-21 13:54:03,730 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/bc73cd46dafc42b99b1af2c544c86ad7 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/bc73cd46dafc42b99b1af2c544c86ad7 2023-11-21 13:54:03,735 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/bc73cd46dafc42b99b1af2c544c86ad7, entries=1, sequenceid=21, filesize=4.9 K 2023-11-21 13:54:03,736 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a9b41c012f2bce1737bed7cb5c4c9b7e in 831ms, sequenceid=21, compaction requested=true 2023-11-21 13:54:03,736 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a9b41c012f2bce1737bed7cb5c4c9b7e: 2023-11-21 13:54:03,736 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:03,736 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:03,736 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:03,736 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:03,736 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:03,736 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:03,739 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:03,739 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:03,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:03,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:03,739 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,739 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:03,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:03,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:03,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:03,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:03,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:03,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b203b87[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:03,740 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:03,741 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,743 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,743 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:03,743 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:03,743 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:03,743 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:03,743 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:03,745 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:03,745 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:03,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:03,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:03,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:03,745 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:03,745 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:03,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:03,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:03,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:03,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:03,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:03,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:03,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:03,747 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:03,747 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:03,747 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:03,747 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,747 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:03,749 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,749 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:03,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:03,749 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:03,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:03,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:03,750 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:03,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:03,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:03,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:03,751 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:03,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:03,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:03,754 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:03,754 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,754 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,754 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:03,754 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:03,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:54:03,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:03,754 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:03,754 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:03,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:03,754 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:03,754 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,754 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:03,754 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,754 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:03,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:03,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:03,855 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:03,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:03,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:03,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:03,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,861 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:54:03,861 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:03,861 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:03,861 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:03,861 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,861 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,863 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:03,864 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:03,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:03,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:03,864 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:03,864 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:03,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:03,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,865 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,865 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-21 13:54:03,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:03,865 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:03,865 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:03,865 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:03,865 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:03,865 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:03,865 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:03,865 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. started... 2023-11-21 13:54:03,865 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a9b41c012f2bce1737bed7cb5c4c9b7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:04,279 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319b0037b23c18429c8500a2b61885e0b5 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512319b0037b23c18429c8500a2b61885e0b5 2023-11-21 13:54:04,685 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/3ef246aac0c24c5db9b18fa7d1bb285a 2023-11-21 13:54:04,690 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/3ef246aac0c24c5db9b18fa7d1bb285a as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/3ef246aac0c24c5db9b18fa7d1bb285a 2023-11-21 13:54:04,695 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/3ef246aac0c24c5db9b18fa7d1bb285a, entries=1, sequenceid=25, filesize=4.9 K 2023-11-21 13:54:04,696 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a9b41c012f2bce1737bed7cb5c4c9b7e in 831ms, sequenceid=25, compaction requested=true 2023-11-21 13:54:04,696 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a9b41c012f2bce1737bed7cb5c4c9b7e: 2023-11-21 13:54:04,696 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:04,696 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:04,696 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:04,696 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:04,696 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:04,696 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:04,698 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:04,698 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:04,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:04,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:04,698 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,698 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:04,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:04,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:04,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:04,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:04,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:04,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6575677e[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:04,700 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:04,700 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,702 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,702 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:04,702 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:04,702 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:04,702 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:04,702 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:04,704 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:04,704 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:04,704 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:04,704 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:04,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:04,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:04,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:04,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:04,706 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:04,707 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:04,707 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:04,707 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,707 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:04,709 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,709 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:04,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:04,709 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:04,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:04,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:04,710 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:04,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:04,711 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:04,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:04,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:04,713 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:04,713 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,713 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,713 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:04,713 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:04,714 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:04,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-21 13:54:04,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:04,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:54:04,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:04,714 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,714 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:04,714 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:04,714 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,714 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:04,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:04,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:04,714 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:04,814 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:04,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:04,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:04,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:04,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,821 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:54:04,821 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:04,821 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:04,821 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:04,821 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,822 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,823 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:04,823 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:04,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:04,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:04,823 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:04,824 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,824 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,825 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-21 13:54:04,825 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:04,825 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:04,825 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:04,825 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:04,825 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:04,825 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:04,825 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:04,825 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. started... 2023-11-21 13:54:04,825 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a9b41c012f2bce1737bed7cb5c4c9b7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:05,240 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101e554073561ae4a6c8eb1c384f2d65be1 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101e554073561ae4a6c8eb1c384f2d65be1 2023-11-21 13:54:05,646 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/184d4ff26f9e4485ab3e1febbad82180 2023-11-21 13:54:05,652 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/184d4ff26f9e4485ab3e1febbad82180 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/184d4ff26f9e4485ab3e1febbad82180 2023-11-21 13:54:05,656 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/184d4ff26f9e4485ab3e1febbad82180, entries=1, sequenceid=29, filesize=4.9 K 2023-11-21 13:54:05,657 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a9b41c012f2bce1737bed7cb5c4c9b7e in 832ms, sequenceid=29, compaction requested=true 2023-11-21 13:54:05,657 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a9b41c012f2bce1737bed7cb5c4c9b7e: 2023-11-21 13:54:05,657 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:05,657 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:05,658 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:05,658 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:05,658 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:05,658 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:05,660 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:05,660 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:05,660 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,660 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:05,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:05,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:05,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7319cdc4[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:05,662 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:05,662 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,665 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,665 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:05,665 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:05,665 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:05,665 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:05,665 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:05,667 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:05,667 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:05,667 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:05,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:05,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:05,667 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:05,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:05,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:05,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:05,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:05,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:05,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:05,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:05,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:05,670 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:05,670 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:05,670 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:05,670 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,670 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:05,674 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,674 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,674 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:05,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:05,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:05,675 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:05,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:05,676 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:05,679 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:05,679 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:05,679 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:05,679 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:05,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:05,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:54:05,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:05,679 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:05,679 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,680 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:05,680 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,680 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:05,680 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:05,680 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:05,680 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:05,780 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:05,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:05,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:05,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:05,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,787 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:54:05,787 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:05,787 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:05,787 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:05,787 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,787 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,789 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:05,789 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:05,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:05,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:05,789 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:05,789 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:05,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:05,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,790 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,791 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-21 13:54:05,791 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:05,791 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:05,791 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:05,791 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:05,791 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:05,791 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:05,791 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:05,791 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. started... 2023-11-21 13:54:05,791 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a9b41c012f2bce1737bed7cb5c4c9b7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:06,204 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ec5a7233a6694aa4a255da27033a236a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103ec5a7233a6694aa4a255da27033a236a 2023-11-21 13:54:06,610 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/a1b3429a00f84a19b5c35a9d30f51d47 2023-11-21 13:54:06,616 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/a1b3429a00f84a19b5c35a9d30f51d47 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/a1b3429a00f84a19b5c35a9d30f51d47 2023-11-21 13:54:06,620 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/a1b3429a00f84a19b5c35a9d30f51d47, entries=1, sequenceid=33, filesize=4.9 K 2023-11-21 13:54:06,621 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a9b41c012f2bce1737bed7cb5c4c9b7e in 830ms, sequenceid=33, compaction requested=true 2023-11-21 13:54:06,621 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a9b41c012f2bce1737bed7cb5c4c9b7e: 2023-11-21 13:54:06,622 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:06,622 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:06,622 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:06,622 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:06,622 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:06,622 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:06,625 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:06,625 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:06,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:06,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:06,625 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,625 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:06,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:06,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:06,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:06,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:06,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:06,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b74d06b[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:06,627 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:06,627 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,628 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,628 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:06,628 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:06,628 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:06,628 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:06,628 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:06,630 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:06,630 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:06,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:06,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:06,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:06,630 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:06,630 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:06,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:06,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:06,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:06,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:06,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:06,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:06,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:06,632 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:06,632 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:06,632 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:06,632 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,632 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:06,634 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,634 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:06,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:06,634 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:06,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,635 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:06,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:06,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:06,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:06,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:06,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,636 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:06,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:06,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:06,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:06,639 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:06,639 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,639 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:06,639 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,639 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:06,639 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-21 13:54:06,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:06,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:06,639 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:06,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:54:06,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:06,639 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:06,640 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,640 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,640 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:06,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:06,640 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:06,640 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:06,740 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:06,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:06,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:06,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:06,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,747 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:54:06,747 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:06,747 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:06,747 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:06,748 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,748 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,749 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:06,749 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:06,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:06,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:06,749 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:06,749 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:06,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:06,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,751 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,751 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-21 13:54:06,751 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:06,751 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:06,751 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:06,751 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:06,751 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:06,751 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:06,751 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:06,751 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. started... 2023-11-21 13:54:06,751 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a9b41c012f2bce1737bed7cb5c4c9b7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:07,165 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907e03a4675f99e48daa39483efc2c2c6dc to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907e03a4675f99e48daa39483efc2c2c6dc 2023-11-21 13:54:07,571 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/a4d7fe4a313a4224858db8668477857a 2023-11-21 13:54:07,577 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/a4d7fe4a313a4224858db8668477857a as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/a4d7fe4a313a4224858db8668477857a 2023-11-21 13:54:07,581 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/a4d7fe4a313a4224858db8668477857a, entries=1, sequenceid=37, filesize=4.9 K 2023-11-21 13:54:07,582 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a9b41c012f2bce1737bed7cb5c4c9b7e in 831ms, sequenceid=37, compaction requested=true 2023-11-21 13:54:07,582 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a9b41c012f2bce1737bed7cb5c4c9b7e: 2023-11-21 13:54:07,582 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:07,582 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:07,582 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:07,583 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:07,583 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:07,583 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:07,584 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:07,584 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:07,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:07,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:07,585 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,585 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:07,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:07,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:07,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:07,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:07,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:07,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51723a81[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:07,586 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:07,586 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,587 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,588 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:07,588 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:07,588 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:07,588 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:07,588 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:07,591 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:07,591 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:07,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:07,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:07,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:07,591 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:07,591 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:07,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:07,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:07,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:07,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:07,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:07,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:07,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:07,594 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:07,594 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:07,594 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:07,594 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,594 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:07,596 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,596 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,596 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:07,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:07,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:07,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:07,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:07,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:07,597 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:07,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:07,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,598 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:07,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:07,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:07,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:07,601 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:07,601 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,601 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,601 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:07,601 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,601 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:07,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-21 13:54:07,601 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:07,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:54:07,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:07,601 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,601 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:07,601 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:07,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:07,601 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:07,601 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:07,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:07,702 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:07,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:07,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:07,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:07,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,708 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:54:07,708 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:07,708 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:07,708 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:07,709 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,709 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,710 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:07,710 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:07,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:07,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:07,711 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:07,711 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:07,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:07,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,712 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,712 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-21 13:54:07,712 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:07,712 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:07,712 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:07,712 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:07,712 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:07,712 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:07,712 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:07,712 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. started... 2023-11-21 13:54:07,712 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a9b41c012f2bce1737bed7cb5c4c9b7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:08,126 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120de465251944147b1969b587cfc9ebed8 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120de465251944147b1969b587cfc9ebed8 2023-11-21 13:54:08,532 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/8ed5464205344c68929860dfb5275ed0 2023-11-21 13:54:08,538 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/8ed5464205344c68929860dfb5275ed0 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/8ed5464205344c68929860dfb5275ed0 2023-11-21 13:54:08,543 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/8ed5464205344c68929860dfb5275ed0, entries=1, sequenceid=41, filesize=4.9 K 2023-11-21 13:54:08,544 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a9b41c012f2bce1737bed7cb5c4c9b7e in 832ms, sequenceid=41, compaction requested=true 2023-11-21 13:54:08,545 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a9b41c012f2bce1737bed7cb5c4c9b7e: 2023-11-21 13:54:08,545 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:08,545 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:08,545 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:08,545 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:08,545 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:08,545 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:08,548 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:08,548 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:08,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:08,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:08,548 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,548 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:08,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:08,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:08,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:08,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:08,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:08,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ff2e946[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:08,550 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:08,550 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,554 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,554 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:08,554 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:08,554 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:08,554 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:08,554 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:08,556 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:08,556 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:08,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:08,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:08,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:08,556 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:08,556 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:08,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:08,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:08,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:08,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:08,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:08,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:08,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:08,559 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:08,559 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:08,559 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:08,559 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,559 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:08,561 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,561 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:08,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:08,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,561 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:08,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:08,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:08,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:08,561 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:08,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:08,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:08,563 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:08,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:08,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:08,566 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:08,566 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:08,566 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:08,566 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,566 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:08,566 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:08,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-21 13:54:08,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-21 13:54:08,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:08,566 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:08,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:08,566 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,566 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,566 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,566 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:08,566 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:08,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:08,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:08,667 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:08,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:08,669 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43219] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-21 13:54:08,670 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-21 13:54:08,671 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-21 13:54:08,672 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:54:08,672 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700575448672 2023-11-21 13:54:08,674 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-21 13:54:08,675 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-21 13:54:08,675 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-21 13:54:08,677 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] zookeeper.ReadOnlyZKClient(139): Connect 0x632c336c to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:54:08,681 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@90348ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:54:08,681 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:09,526 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037b396a7532334a78b1dbe65198431922 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601037b396a7532334a78b1dbe65198431922 2023-11-21 13:54:09,527 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-21 13:54:09,540 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:54:09,541 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:58936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:54:09,548 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-21 13:54:09,549 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:60336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-21 13:54:09,558 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/379469cd8f334ca88fc12557e163edf5 first=Optional[r3] last=Optional[r6] 2023-11-21 13:54:09,559 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/379469cd8f334ca88fc12557e163edf5}] 2023-11-21 13:54:09,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/379469cd8f334ca88fc12557e163edf5 for inclusion in a9b41c012f2bce1737bed7cb5c4c9b7e/family1 2023-11-21 13:54:09,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-21 13:54:09,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:54:09,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for a9b41c012f2bce1737bed7cb5c4c9b7e: 2023-11-21 13:54:09,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/379469cd8f334ca88fc12557e163edf5 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k5iarqt29tn1f03hq6hoefisqlc16h42fgvcsgovkd7ili7s7515m4eai6vmqret/family1/379469cd8f334ca88fc12557e163edf5 2023-11-21 13:54:09,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k5iarqt29tn1f03hq6hoefisqlc16h42fgvcsgovkd7ili7s7515m4eai6vmqret/family1/379469cd8f334ca88fc12557e163edf5 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/980f917a677a4f0481b70eec433dae43_SeqId_44_ 2023-11-21 13:54:09,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k5iarqt29tn1f03hq6hoefisqlc16h42fgvcsgovkd7ili7s7515m4eai6vmqret/family1/379469cd8f334ca88fc12557e163edf5 into a9b41c012f2bce1737bed7cb5c4c9b7e/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/980f917a677a4f0481b70eec433dae43_SeqId_44_ - updating store file list. 2023-11-21 13:54:09,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/980f917a677a4f0481b70eec433dae43_SeqId_44_ into a9b41c012f2bce1737bed7cb5c4c9b7e/family1 2023-11-21 13:54:09,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k5iarqt29tn1f03hq6hoefisqlc16h42fgvcsgovkd7ili7s7515m4eai6vmqret/family1/379469cd8f334ca88fc12557e163edf5 into a9b41c012f2bce1737bed7cb5c4c9b7e/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/980f917a677a4f0481b70eec433dae43_SeqId_44_) 2023-11-21 13:54:09,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k5iarqt29tn1f03hq6hoefisqlc16h42fgvcsgovkd7ili7s7515m4eai6vmqret/family1/379469cd8f334ca88fc12557e163edf5 2023-11-21 13:54:09,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-21 13:54:09,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-21 13:54:09,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(1912): a9b41c012f2bce1737bed7cb5c4c9b7e/family1 is initiating minor compaction 2023-11-21 13:54:09,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7c6d7f8a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:54:09,578 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a9b41c012f2bce1737bed7cb5c4c9b7e/family1 in testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:09,578 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/bb9ce06302e0487dbe27ecc0d64556ed, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/ca0eb1d6e31942999161646f8fc2a619, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/e895387fae014092a6d27b337ff9407a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/bc73cd46dafc42b99b1af2c544c86ad7, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/3ef246aac0c24c5db9b18fa7d1bb285a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/184d4ff26f9e4485ab3e1febbad82180, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/a1b3429a00f84a19b5c35a9d30f51d47, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/a4d7fe4a313a4224858db8668477857a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/8ed5464205344c68929860dfb5275ed0, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/980f917a677a4f0481b70eec433dae43_SeqId_44_] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp, totalSize=50.0 K 2023-11-21 13:54:09,578 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting bb9ce06302e0487dbe27ecc0d64556ed, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-21 13:54:09,579 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting ca0eb1d6e31942999161646f8fc2a619, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-21 13:54:09,579 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting e895387fae014092a6d27b337ff9407a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-21 13:54:09,579 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting bc73cd46dafc42b99b1af2c544c86ad7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-21 13:54:09,579 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 3ef246aac0c24c5db9b18fa7d1bb285a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-21 13:54:09,579 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 184d4ff26f9e4485ab3e1febbad82180, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-21 13:54:09,579 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting a1b3429a00f84a19b5c35a9d30f51d47, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-21 13:54:09,579 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting a4d7fe4a313a4224858db8668477857a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-21 13:54:09,579 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 8ed5464205344c68929860dfb5275ed0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-21 13:54:09,579 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 980f917a677a4f0481b70eec433dae43_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-21 13:54:09,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-21 13:54:09,581 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:09,582 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228e47bb49ada374dc3bab2c5230595d747 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228e47bb49ada374dc3bab2c5230595d747 2023-11-21 13:54:09,584 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512319b0037b23c18429c8500a2b61885e0b5 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512319b0037b23c18429c8500a2b61885e0b5 2023-11-21 13:54:09,585 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101e554073561ae4a6c8eb1c384f2d65be1 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101e554073561ae4a6c8eb1c384f2d65be1 2023-11-21 13:54:09,587 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103ec5a7233a6694aa4a255da27033a236a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103ec5a7233a6694aa4a255da27033a236a 2023-11-21 13:54:09,587 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-21 13:54:09,587 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-21 13:54:09,588 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:09,588 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:09,588 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:09,588 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:09,588 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:09,588 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:09,588 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:09,588 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:09,618 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): a9b41c012f2bce1737bed7cb5c4c9b7e#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:54:10,426 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205dd796337332a49aabaf61106b5391f35 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205dd796337332a49aabaf61106b5391f35 2023-11-21 13:54:10,427 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-21 13:54:10,431 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/7ff735d686ed4c0d911d0aa3291be702 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/7ff735d686ed4c0d911d0aa3291be702 2023-11-21 13:54:10,437 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in a9b41c012f2bce1737bed7cb5c4c9b7e/family1 of a9b41c012f2bce1737bed7cb5c4c9b7e into 7ff735d686ed4c0d911d0aa3291be702(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:54:10,437 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a9b41c012f2bce1737bed7cb5c4c9b7e: 2023-11-21 13:54:10,437 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1700574849578; duration=0sec 2023-11-21 13:54:10,438 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:54:10,459 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f23a8bd04c5149019f0a1f0498119f26 first=Optional[r1] last=Optional[r2] 2023-11-21 13:54:10,459 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f23a8bd04c5149019f0a1f0498119f26}] 2023-11-21 13:54:10,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f23a8bd04c5149019f0a1f0498119f26 for inclusion in a9b41c012f2bce1737bed7cb5c4c9b7e/family1 2023-11-21 13:54:10,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-21 13:54:10,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:54:10,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for a9b41c012f2bce1737bed7cb5c4c9b7e: 2023-11-21 13:54:10,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f23a8bd04c5149019f0a1f0498119f26 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__p7gv7tbrl9gveo5uhnkg4ho948go9lftl22pp9aotao9kcdrm8a5dndc026efmh5/family1/f23a8bd04c5149019f0a1f0498119f26 2023-11-21 13:54:10,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__p7gv7tbrl9gveo5uhnkg4ho948go9lftl22pp9aotao9kcdrm8a5dndc026efmh5/family1/f23a8bd04c5149019f0a1f0498119f26 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/dbea571463c34020845a33459dc40ca4_SeqId_47_ 2023-11-21 13:54:10,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__p7gv7tbrl9gveo5uhnkg4ho948go9lftl22pp9aotao9kcdrm8a5dndc026efmh5/family1/f23a8bd04c5149019f0a1f0498119f26 into a9b41c012f2bce1737bed7cb5c4c9b7e/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/dbea571463c34020845a33459dc40ca4_SeqId_47_ - updating store file list. 2023-11-21 13:54:10,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/dbea571463c34020845a33459dc40ca4_SeqId_47_ into a9b41c012f2bce1737bed7cb5c4c9b7e/family1 2023-11-21 13:54:10,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__p7gv7tbrl9gveo5uhnkg4ho948go9lftl22pp9aotao9kcdrm8a5dndc026efmh5/family1/f23a8bd04c5149019f0a1f0498119f26 into a9b41c012f2bce1737bed7cb5c4c9b7e/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/dbea571463c34020845a33459dc40ca4_SeqId_47_) 2023-11-21 13:54:10,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__p7gv7tbrl9gveo5uhnkg4ho948go9lftl22pp9aotao9kcdrm8a5dndc026efmh5/family1/f23a8bd04c5149019f0a1f0498119f26 2023-11-21 13:54:10,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-21 13:54:10,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-21 13:54:10,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(1912): a9b41c012f2bce1737bed7cb5c4c9b7e/family1 is initiating minor compaction (all files) 2023-11-21 13:54:10,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3c44a1bb; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:54:10,476 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a9b41c012f2bce1737bed7cb5c4c9b7e/family1 in testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:54:10,476 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/19d9e528a3eb4a96a72f996758ab7824, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/7ff735d686ed4c0d911d0aa3291be702, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/dbea571463c34020845a33459dc40ca4_SeqId_47_] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp, totalSize=176.8 K 2023-11-21 13:54:10,477 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 19d9e528a3eb4a96a72f996758ab7824, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878827509 2023-11-21 13:54:10,477 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 7ff735d686ed4c0d911d0aa3291be702, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621227509 2023-11-21 13:54:10,478 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting dbea571463c34020845a33459dc40ca4_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965227509 2023-11-21 13:54:10,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-21 13:54:10,478 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:10,480 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201cf3731eae43f43fbaba621f53fe68d43 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201cf3731eae43f43fbaba621f53fe68d43 2023-11-21 13:54:10,482 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512051d9f86bd3d4c4d2580f9636a8b2ab476 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512051d9f86bd3d4c4d2580f9636a8b2ab476 2023-11-21 13:54:10,482 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-21 13:54:10,482 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-21 13:54:10,483 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:10,483 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-21 13:54:10,483 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:54:10,484 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-21 13:54:10,486 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8150 sec 2023-11-21 13:54:10,505 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): a9b41c012f2bce1737bed7cb5c4c9b7e#family1#compaction#35 average throughput is 9.67 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:54:10,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/bb9ce06302e0487dbe27ecc0d64556ed, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/ca0eb1d6e31942999161646f8fc2a619, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/e895387fae014092a6d27b337ff9407a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/bc73cd46dafc42b99b1af2c544c86ad7, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/3ef246aac0c24c5db9b18fa7d1bb285a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/184d4ff26f9e4485ab3e1febbad82180, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/a1b3429a00f84a19b5c35a9d30f51d47, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/a4d7fe4a313a4224858db8668477857a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/8ed5464205344c68929860dfb5275ed0, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/980f917a677a4f0481b70eec433dae43_SeqId_44_] to archive 2023-11-21 13:54:10,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:10,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/bb9ce06302e0487dbe27ecc0d64556ed to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/bb9ce06302e0487dbe27ecc0d64556ed 2023-11-21 13:54:10,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/ca0eb1d6e31942999161646f8fc2a619 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/ca0eb1d6e31942999161646f8fc2a619 2023-11-21 13:54:10,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/e895387fae014092a6d27b337ff9407a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/e895387fae014092a6d27b337ff9407a 2023-11-21 13:54:10,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/bc73cd46dafc42b99b1af2c544c86ad7 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/bc73cd46dafc42b99b1af2c544c86ad7 2023-11-21 13:54:10,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/3ef246aac0c24c5db9b18fa7d1bb285a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/3ef246aac0c24c5db9b18fa7d1bb285a 2023-11-21 13:54:10,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/184d4ff26f9e4485ab3e1febbad82180 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/184d4ff26f9e4485ab3e1febbad82180 2023-11-21 13:54:10,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/a1b3429a00f84a19b5c35a9d30f51d47 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/a1b3429a00f84a19b5c35a9d30f51d47 2023-11-21 13:54:10,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/a4d7fe4a313a4224858db8668477857a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/a4d7fe4a313a4224858db8668477857a 2023-11-21 13:54:10,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/8ed5464205344c68929860dfb5275ed0 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/8ed5464205344c68929860dfb5275ed0 2023-11-21 13:54:10,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/980f917a677a4f0481b70eec433dae43_SeqId_44_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/980f917a677a4f0481b70eec433dae43_SeqId_44_ 2023-11-21 13:54:10,525 DEBUG [hfile_cleaner-dir-scan-pool-1] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 29 more 2023-11-21 13:54:10,592 INFO [Listener at localhost/35077] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=264 (was 263) - Thread LEAK? -, OpenFileDescriptor=653 (was 644) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=269 (was 306), ProcessCount=174 (was 174), AvailableMemoryMB=7084 (was 7177) 2023-11-21 13:54:10,604 INFO [Listener at localhost/35077] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=264, OpenFileDescriptor=653, MaxFileDescriptor=60000, SystemLoadAverage=269, ProcessCount=174, AvailableMemoryMB=7084 2023-11-21 13:54:10,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-21 13:54:10,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:10,609 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-21 13:54:10,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-21 13:54:10,609 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-21 13:54:10,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-21 13:54:10,612 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5e019165ab563441c6490eadcc58d4e7 2023-11-21 13:54:10,612 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/42379350746f695b24783d6548efae7f 2023-11-21 13:54:10,612 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85 2023-11-21 13:54:10,612 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5e019165ab563441c6490eadcc58d4e7 empty. 2023-11-21 13:54:10,612 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/42379350746f695b24783d6548efae7f empty. 2023-11-21 13:54:10,612 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85 empty. 2023-11-21 13:54:10,613 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5e019165ab563441c6490eadcc58d4e7 2023-11-21 13:54:10,613 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85 2023-11-21 13:54:10,613 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/42379350746f695b24783d6548efae7f 2023-11-21 13:54:10,613 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-21 13:54:10,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-21 13:54:10,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-21 13:54:11,022 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-21 13:54:11,024 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 7f56f11b9f2883e62033f7f9de924a85, NAME => 'testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:54:11,024 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 42379350746f695b24783d6548efae7f, NAME => 'testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:54:11,024 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5e019165ab563441c6490eadcc58d4e7, NAME => 'testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:54:11,037 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:54:11,037 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 42379350746f695b24783d6548efae7f, disabling compactions & flushes 2023-11-21 13:54:11,037 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. 2023-11-21 13:54:11,037 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. 2023-11-21 13:54:11,037 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. after waiting 0 ms 2023-11-21 13:54:11,037 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. 2023-11-21 13:54:11,037 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. 2023-11-21 13:54:11,037 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 42379350746f695b24783d6548efae7f: 2023-11-21 13:54:11,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-21 13:54:11,333 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/.tmp/family1/92d7e25a6ce2406e8ff8c8d9b6e884a7 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/92d7e25a6ce2406e8ff8c8d9b6e884a7 2023-11-21 13:54:11,338 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in a9b41c012f2bce1737bed7cb5c4c9b7e/family1 of a9b41c012f2bce1737bed7cb5c4c9b7e into 92d7e25a6ce2406e8ff8c8d9b6e884a7(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:54:11,338 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a9b41c012f2bce1737bed7cb5c4c9b7e: 2023-11-21 13:54:11,338 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1700574850476; duration=0sec 2023-11-21 13:54:11,339 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:54:11,395 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/19d9e528a3eb4a96a72f996758ab7824, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/7ff735d686ed4c0d911d0aa3291be702, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/dbea571463c34020845a33459dc40ca4_SeqId_47_] to archive 2023-11-21 13:54:11,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:11,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/19d9e528a3eb4a96a72f996758ab7824 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/19d9e528a3eb4a96a72f996758ab7824 2023-11-21 13:54:11,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/7ff735d686ed4c0d911d0aa3291be702 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/7ff735d686ed4c0d911d0aa3291be702 2023-11-21 13:54:11,400 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/dbea571463c34020845a33459dc40ca4_SeqId_47_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/family1/dbea571463c34020845a33459dc40ca4_SeqId_47_ 2023-11-21 13:54:11,432 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:54:11,432 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 7f56f11b9f2883e62033f7f9de924a85, disabling compactions & flushes 2023-11-21 13:54:11,433 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. 2023-11-21 13:54:11,433 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. 2023-11-21 13:54:11,433 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. after waiting 0 ms 2023-11-21 13:54:11,433 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. 2023-11-21 13:54:11,433 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. 2023-11-21 13:54:11,433 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 7f56f11b9f2883e62033f7f9de924a85: 2023-11-21 13:54:11,437 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:54:11,437 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 5e019165ab563441c6490eadcc58d4e7, disabling compactions & flushes 2023-11-21 13:54:11,437 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. 2023-11-21 13:54:11,437 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. 2023-11-21 13:54:11,437 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. after waiting 0 ms 2023-11-21 13:54:11,437 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. 2023-11-21 13:54:11,437 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. 2023-11-21 13:54:11,437 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 5e019165ab563441c6490eadcc58d4e7: 2023-11-21 13:54:11,440 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-21 13:54:11,441 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700574851440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574851440"}]},"ts":"1700574851440"} 2023-11-21 13:54:11,441 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700574851440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574851440"}]},"ts":"1700574851440"} 2023-11-21 13:54:11,441 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700574851440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574851440"}]},"ts":"1700574851440"} 2023-11-21 13:54:11,443 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-21 13:54:11,444 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-21 13:54:11,444 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574851444"}]},"ts":"1700574851444"} 2023-11-21 13:54:11,446 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-21 13:54:11,449 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5e019165ab563441c6490eadcc58d4e7, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=42379350746f695b24783d6548efae7f, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7f56f11b9f2883e62033f7f9de924a85, ASSIGN}] 2023-11-21 13:54:11,451 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7f56f11b9f2883e62033f7f9de924a85, ASSIGN 2023-11-21 13:54:11,451 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=42379350746f695b24783d6548efae7f, ASSIGN 2023-11-21 13:54:11,451 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5e019165ab563441c6490eadcc58d4e7, ASSIGN 2023-11-21 13:54:11,452 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7f56f11b9f2883e62033f7f9de924a85, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:54:11,452 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5e019165ab563441c6490eadcc58d4e7, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:54:11,452 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=42379350746f695b24783d6548efae7f, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:54:11,603 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=7f56f11b9f2883e62033f7f9de924a85, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:11,603 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=42379350746f695b24783d6548efae7f, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:11,603 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=5e019165ab563441c6490eadcc58d4e7, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:11,604 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700574851603"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574851603"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574851603"}]},"ts":"1700574851603"} 2023-11-21 13:54:11,604 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700574851603"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574851603"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574851603"}]},"ts":"1700574851603"} 2023-11-21 13:54:11,604 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700574851603"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574851603"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574851603"}]},"ts":"1700574851603"} 2023-11-21 13:54:11,605 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; OpenRegionProcedure 7f56f11b9f2883e62033f7f9de924a85, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:54:11,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure 5e019165ab563441c6490eadcc58d4e7, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:54:11,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure 42379350746f695b24783d6548efae7f, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:54:11,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-21 13:54:11,757 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:11,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. 2023-11-21 13:54:11,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7f56f11b9f2883e62033f7f9de924a85, NAME => 'testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85.', STARTKEY => '2', ENDKEY => ''} 2023-11-21 13:54:11,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 7f56f11b9f2883e62033f7f9de924a85 2023-11-21 13:54:11,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:54:11,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 7f56f11b9f2883e62033f7f9de924a85 2023-11-21 13:54:11,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 7f56f11b9f2883e62033f7f9de924a85 2023-11-21 13:54:11,763 INFO [StoreOpener-7f56f11b9f2883e62033f7f9de924a85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7f56f11b9f2883e62033f7f9de924a85 2023-11-21 13:54:11,765 DEBUG [StoreOpener-7f56f11b9f2883e62033f7f9de924a85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1 2023-11-21 13:54:11,765 DEBUG [StoreOpener-7f56f11b9f2883e62033f7f9de924a85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1 2023-11-21 13:54:11,765 INFO [StoreOpener-7f56f11b9f2883e62033f7f9de924a85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f56f11b9f2883e62033f7f9de924a85 columnFamilyName family1 2023-11-21 13:54:11,767 INFO [StoreOpener-7f56f11b9f2883e62033f7f9de924a85-1] regionserver.HStore(310): Store=7f56f11b9f2883e62033f7f9de924a85/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:54:11,767 INFO [StoreOpener-7f56f11b9f2883e62033f7f9de924a85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7f56f11b9f2883e62033f7f9de924a85 2023-11-21 13:54:11,768 DEBUG [StoreOpener-7f56f11b9f2883e62033f7f9de924a85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family2 2023-11-21 13:54:11,768 DEBUG [StoreOpener-7f56f11b9f2883e62033f7f9de924a85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family2 2023-11-21 13:54:11,769 INFO [StoreOpener-7f56f11b9f2883e62033f7f9de924a85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f56f11b9f2883e62033f7f9de924a85 columnFamilyName family2 2023-11-21 13:54:11,770 INFO [StoreOpener-7f56f11b9f2883e62033f7f9de924a85-1] regionserver.HStore(310): Store=7f56f11b9f2883e62033f7f9de924a85/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:54:11,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85 2023-11-21 13:54:11,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85 2023-11-21 13:54:11,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-21 13:54:11,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 7f56f11b9f2883e62033f7f9de924a85 2023-11-21 13:54:11,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:54:11,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 7f56f11b9f2883e62033f7f9de924a85; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66857878, jitterRate=-0.003739982843399048}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-21 13:54:11,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 7f56f11b9f2883e62033f7f9de924a85: 2023-11-21 13:54:11,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85., pid=31, masterSystemTime=1700574851757 2023-11-21 13:54:11,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. 2023-11-21 13:54:11,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. 2023-11-21 13:54:11,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. 2023-11-21 13:54:11,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 42379350746f695b24783d6548efae7f, NAME => 'testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f.', STARTKEY => '1', ENDKEY => '2'} 2023-11-21 13:54:11,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 42379350746f695b24783d6548efae7f 2023-11-21 13:54:11,781 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=7f56f11b9f2883e62033f7f9de924a85, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:11,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:54:11,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 42379350746f695b24783d6548efae7f 2023-11-21 13:54:11,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 42379350746f695b24783d6548efae7f 2023-11-21 13:54:11,781 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700574851781"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574851781"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574851781"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574851781"}]},"ts":"1700574851781"} 2023-11-21 13:54:11,782 INFO [StoreOpener-42379350746f695b24783d6548efae7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 42379350746f695b24783d6548efae7f 2023-11-21 13:54:11,784 DEBUG [StoreOpener-42379350746f695b24783d6548efae7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/42379350746f695b24783d6548efae7f/family1 2023-11-21 13:54:11,784 DEBUG [StoreOpener-42379350746f695b24783d6548efae7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/42379350746f695b24783d6548efae7f/family1 2023-11-21 13:54:11,784 INFO [StoreOpener-42379350746f695b24783d6548efae7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42379350746f695b24783d6548efae7f columnFamilyName family1 2023-11-21 13:54:11,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=31, resume processing ppid=30 2023-11-21 13:54:11,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=30, state=SUCCESS; OpenRegionProcedure 7f56f11b9f2883e62033f7f9de924a85, server=jenkins-hbase6.apache.org,46365,1700574804408 in 178 msec 2023-11-21 13:54:11,785 INFO [StoreOpener-42379350746f695b24783d6548efae7f-1] regionserver.HStore(310): Store=42379350746f695b24783d6548efae7f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:54:11,786 INFO [StoreOpener-42379350746f695b24783d6548efae7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 42379350746f695b24783d6548efae7f 2023-11-21 13:54:11,786 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7f56f11b9f2883e62033f7f9de924a85, ASSIGN in 336 msec 2023-11-21 13:54:11,787 DEBUG [StoreOpener-42379350746f695b24783d6548efae7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/42379350746f695b24783d6548efae7f/family2 2023-11-21 13:54:11,787 DEBUG [StoreOpener-42379350746f695b24783d6548efae7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/42379350746f695b24783d6548efae7f/family2 2023-11-21 13:54:11,788 INFO [StoreOpener-42379350746f695b24783d6548efae7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42379350746f695b24783d6548efae7f columnFamilyName family2 2023-11-21 13:54:11,789 INFO [StoreOpener-42379350746f695b24783d6548efae7f-1] regionserver.HStore(310): Store=42379350746f695b24783d6548efae7f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:54:11,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/42379350746f695b24783d6548efae7f 2023-11-21 13:54:11,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/42379350746f695b24783d6548efae7f 2023-11-21 13:54:11,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-21 13:54:11,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 42379350746f695b24783d6548efae7f 2023-11-21 13:54:11,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/42379350746f695b24783d6548efae7f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:54:11,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 42379350746f695b24783d6548efae7f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60767326, jitterRate=-0.09449627995491028}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-21 13:54:11,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 42379350746f695b24783d6548efae7f: 2023-11-21 13:54:11,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f., pid=33, masterSystemTime=1700574851757 2023-11-21 13:54:11,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. 2023-11-21 13:54:11,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. 2023-11-21 13:54:11,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. 2023-11-21 13:54:11,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5e019165ab563441c6490eadcc58d4e7, NAME => 'testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7.', STARTKEY => '', ENDKEY => '1'} 2023-11-21 13:54:11,799 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=42379350746f695b24783d6548efae7f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:11,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 5e019165ab563441c6490eadcc58d4e7 2023-11-21 13:54:11,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:54:11,799 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700574851799"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574851799"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574851799"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574851799"}]},"ts":"1700574851799"} 2023-11-21 13:54:11,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 5e019165ab563441c6490eadcc58d4e7 2023-11-21 13:54:11,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 5e019165ab563441c6490eadcc58d4e7 2023-11-21 13:54:11,801 INFO [StoreOpener-5e019165ab563441c6490eadcc58d4e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5e019165ab563441c6490eadcc58d4e7 2023-11-21 13:54:11,803 DEBUG [StoreOpener-5e019165ab563441c6490eadcc58d4e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/5e019165ab563441c6490eadcc58d4e7/family1 2023-11-21 13:54:11,803 DEBUG [StoreOpener-5e019165ab563441c6490eadcc58d4e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/5e019165ab563441c6490eadcc58d4e7/family1 2023-11-21 13:54:11,803 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=33, resume processing ppid=29 2023-11-21 13:54:11,803 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure 42379350746f695b24783d6548efae7f, server=jenkins-hbase6.apache.org,46365,1700574804408 in 194 msec 2023-11-21 13:54:11,803 INFO [StoreOpener-5e019165ab563441c6490eadcc58d4e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e019165ab563441c6490eadcc58d4e7 columnFamilyName family1 2023-11-21 13:54:11,804 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=42379350746f695b24783d6548efae7f, ASSIGN in 354 msec 2023-11-21 13:54:11,805 INFO [StoreOpener-5e019165ab563441c6490eadcc58d4e7-1] regionserver.HStore(310): Store=5e019165ab563441c6490eadcc58d4e7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:54:11,805 INFO [StoreOpener-5e019165ab563441c6490eadcc58d4e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5e019165ab563441c6490eadcc58d4e7 2023-11-21 13:54:11,807 DEBUG [StoreOpener-5e019165ab563441c6490eadcc58d4e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/5e019165ab563441c6490eadcc58d4e7/family2 2023-11-21 13:54:11,807 DEBUG [StoreOpener-5e019165ab563441c6490eadcc58d4e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/5e019165ab563441c6490eadcc58d4e7/family2 2023-11-21 13:54:11,807 INFO [StoreOpener-5e019165ab563441c6490eadcc58d4e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e019165ab563441c6490eadcc58d4e7 columnFamilyName family2 2023-11-21 13:54:11,808 INFO [StoreOpener-5e019165ab563441c6490eadcc58d4e7-1] regionserver.HStore(310): Store=5e019165ab563441c6490eadcc58d4e7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:54:11,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/5e019165ab563441c6490eadcc58d4e7 2023-11-21 13:54:11,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/5e019165ab563441c6490eadcc58d4e7 2023-11-21 13:54:11,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-21 13:54:11,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 5e019165ab563441c6490eadcc58d4e7 2023-11-21 13:54:11,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/5e019165ab563441c6490eadcc58d4e7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:54:11,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 5e019165ab563441c6490eadcc58d4e7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67592267, jitterRate=0.007203266024589539}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-21 13:54:11,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 5e019165ab563441c6490eadcc58d4e7: 2023-11-21 13:54:11,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7., pid=32, masterSystemTime=1700574851757 2023-11-21 13:54:11,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. 2023-11-21 13:54:11,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. 2023-11-21 13:54:11,819 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=5e019165ab563441c6490eadcc58d4e7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:11,819 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700574851819"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574851819"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574851819"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574851819"}]},"ts":"1700574851819"} 2023-11-21 13:54:11,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=32, resume processing ppid=28 2023-11-21 13:54:11,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure 5e019165ab563441c6490eadcc58d4e7, server=jenkins-hbase6.apache.org,46365,1700574804408 in 215 msec 2023-11-21 13:54:11,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=28, resume processing ppid=27 2023-11-21 13:54:11,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5e019165ab563441c6490eadcc58d4e7, ASSIGN in 374 msec 2023-11-21 13:54:11,826 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-21 13:54:11,826 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574851826"}]},"ts":"1700574851826"} 2023-11-21 13:54:11,827 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-21 13:54:11,830 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-21 13:54:11,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2240 sec 2023-11-21 13:54:12,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-21 13:54:12,715 INFO [Listener at localhost/35077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-21 13:54:12,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:12,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:12,723 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-21 13:54:12,723 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:12,724 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-21 13:54:12,724 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-21 13:54:12,724 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:12,724 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:12,727 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:12,727 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:12,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:12,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:12,727 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:12,727 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:12,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:12,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:12,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:12,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:12,728 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:12,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:12,729 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-21 13:54:12,729 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:12,729 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-21 13:54:12,730 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. 2023-11-21 13:54:12,730 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. started... 2023-11-21 13:54:12,733 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 42379350746f695b24783d6548efae7f: 2023-11-21 13:54:12,733 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. 2023-11-21 13:54:12,733 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-21 13:54:12,733 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. 2023-11-21 13:54:12,733 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. 2023-11-21 13:54:12,733 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. started... 2023-11-21 13:54:12,733 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:12,733 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. started... 2023-11-21 13:54:12,733 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5e019165ab563441c6490eadcc58d4e7: 2023-11-21 13:54:12,733 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-21 13:54:12,734 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7f56f11b9f2883e62033f7f9de924a85 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-21 13:54:12,733 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. 2023-11-21 13:54:12,734 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-21 13:54:13,147 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231121addeca27d39f490da0bb89519f8a704b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231121addeca27d39f490da0bb89519f8a704b 2023-11-21 13:54:13,553 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/.tmp/family1/87249eb2650a4d38a5263882c3b5b9f1 2023-11-21 13:54:13,559 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/.tmp/family1/87249eb2650a4d38a5263882c3b5b9f1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/87249eb2650a4d38a5263882c3b5b9f1 2023-11-21 13:54:13,563 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/87249eb2650a4d38a5263882c3b5b9f1, entries=1, sequenceid=5, filesize=4.9 K 2023-11-21 13:54:13,564 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 7f56f11b9f2883e62033f7f9de924a85 in 830ms, sequenceid=5, compaction requested=false 2023-11-21 13:54:13,564 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-21 13:54:13,565 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7f56f11b9f2883e62033f7f9de924a85: 2023-11-21 13:54:13,565 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. 2023-11-21 13:54:13,565 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-21 13:54:13,565 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-21 13:54:13,565 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:13,565 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-21 13:54:13,565 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-21 13:54:13,567 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:13,567 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:13,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:13,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:13,568 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,568 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:13,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:13,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:13,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:13,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:13,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-21 13:54:13,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22b86091[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:13,570 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-21 13:54:13,570 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,571 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,571 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-21 13:54:13,571 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-21 13:54:13,571 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:13,571 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:13,571 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:13,573 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-21 13:54:13,573 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:13,573 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:13,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:13,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:13,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:13,573 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-21 13:54:13,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:13,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:13,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:13,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:13,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:13,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:13,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-21 13:54:13,576 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-21 13:54:13,576 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:13,576 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:13,576 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,576 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:13,580 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,580 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:13,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:13,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,580 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:13,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:13,580 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:13,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:13,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:13,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:13,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:13,582 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:13,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:13,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:13,585 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:13,585 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,585 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,585 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:13,585 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:13,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:13,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:13,585 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:13,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-21 13:54:13,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:13,585 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:13,585 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,585 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:13,585 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:13,586 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:13,585 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:13,686 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:13,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:13,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:13,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:13,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,693 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-21 13:54:13,693 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:13,693 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-21 13:54:13,693 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-21 13:54:13,693 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,694 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,695 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:13,695 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:13,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:13,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:13,695 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:13,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,695 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:13,696 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:13,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,696 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,696 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-21 13:54:13,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:13,697 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-21 13:54:13,697 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:13,697 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-21 13:54:13,697 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. 2023-11-21 13:54:13,697 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. started... 2023-11-21 13:54:13,697 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. 2023-11-21 13:54:13,697 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-21 13:54:13,697 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 42379350746f695b24783d6548efae7f: 2023-11-21 13:54:13,697 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. started... 2023-11-21 13:54:13,697 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. 2023-11-21 13:54:13,697 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:13,697 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7f56f11b9f2883e62033f7f9de924a85 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-21 13:54:13,697 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. 2023-11-21 13:54:13,697 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-21 13:54:13,697 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. started... 2023-11-21 13:54:13,697 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5e019165ab563441c6490eadcc58d4e7: 2023-11-21 13:54:13,697 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. 2023-11-21 13:54:13,698 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-21 13:54:14,110 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311219dee4d614fdc49c6890ad16c1540abee to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311219dee4d614fdc49c6890ad16c1540abee 2023-11-21 13:54:14,516 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/.tmp/family1/1811f1028f594779a16054cd078292ce 2023-11-21 13:54:14,521 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/.tmp/family1/1811f1028f594779a16054cd078292ce as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/1811f1028f594779a16054cd078292ce 2023-11-21 13:54:14,525 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/1811f1028f594779a16054cd078292ce, entries=2, sequenceid=9, filesize=5.0 K 2023-11-21 13:54:14,526 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 7f56f11b9f2883e62033f7f9de924a85 in 829ms, sequenceid=9, compaction requested=false 2023-11-21 13:54:14,526 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7f56f11b9f2883e62033f7f9de924a85: 2023-11-21 13:54:14,526 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. 2023-11-21 13:54:14,527 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-21 13:54:14,527 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-21 13:54:14,527 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:14,527 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-21 13:54:14,527 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-21 13:54:14,529 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:14,529 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:14,529 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:14,529 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:14,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-21 13:54:14,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f420b25[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:14,531 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-21 13:54:14,531 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,533 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,533 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-21 13:54:14,533 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-21 13:54:14,533 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:14,534 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:14,534 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:14,535 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:14,535 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-21 13:54:14,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:14,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:14,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:14,535 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:14,535 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-21 13:54:14,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:14,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:14,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:14,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:14,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:14,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:14,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-21 13:54:14,539 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-21 13:54:14,539 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:14,539 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:14,539 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,539 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:14,541 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,541 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,541 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:14,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:14,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:14,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:14,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:14,542 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:14,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:14,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:14,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,544 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:14,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:14,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:14,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:14,550 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:14,550 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:14,551 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:14,551 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:14,551 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:14,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:14,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-21 13:54:14,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:14,551 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-21 13:54:14,551 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:14,551 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:14,551 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:14,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:14,551 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,551 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:14,552 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,652 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:14,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:14,659 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43219] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-21 13:54:14,661 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-21 13:54:14,662 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-21 13:54:14,663 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:54:14,663 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700575454663 2023-11-21 13:54:14,663 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-21 13:54:14,664 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-21 13:54:14,664 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-21 13:54:14,665 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] zookeeper.ReadOnlyZKClient(139): Connect 0x3d577689 to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:54:14,670 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e022798, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:54:14,670 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231121 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-21 13:54:15,498 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231121dc8a325ae4814f38babed4d16dd1385b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231121dc8a325ae4814f38babed4d16dd1385b 2023-11-21 13:54:15,499 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231121 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-21 13:54:15,513 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:54:15,514 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:39130, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:54:15,521 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-21 13:54:15,523 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:55330, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-21 13:54:15,532 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231121/family1/06ceb2acd1604f99b0b4eea31a7e6cdc first=Optional[k0] last=Optional[k1] 2023-11-21 13:54:15,532 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231121/family1/06ceb2acd1604f99b0b4eea31a7e6cdc}] 2023-11-21 13:54:15,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231121/family1/06ceb2acd1604f99b0b4eea31a7e6cdc for inclusion in 7f56f11b9f2883e62033f7f9de924a85/family1 2023-11-21 13:54:15,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-21 13:54:15,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-21 13:54:15,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 7f56f11b9f2883e62033f7f9de924a85: 2023-11-21 13:54:15,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231121/family1/06ceb2acd1604f99b0b4eea31a7e6cdc to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testScannerOnBulkLoadRefHFiles__jl79eh1db9r9bml1jq4cs0oij1fvbbpdklr1n3kg4hi5nmtjr891du80837a3a5q/family1/06ceb2acd1604f99b0b4eea31a7e6cdc 2023-11-21 13:54:15,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testScannerOnBulkLoadRefHFiles__jl79eh1db9r9bml1jq4cs0oij1fvbbpdklr1n3kg4hi5nmtjr891du80837a3a5q/family1/06ceb2acd1604f99b0b4eea31a7e6cdc as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/75f92c84970343a8b7dc534e78fd25a3_SeqId_12_ 2023-11-21 13:54:15,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testScannerOnBulkLoadRefHFiles__jl79eh1db9r9bml1jq4cs0oij1fvbbpdklr1n3kg4hi5nmtjr891du80837a3a5q/family1/06ceb2acd1604f99b0b4eea31a7e6cdc into 7f56f11b9f2883e62033f7f9de924a85/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/75f92c84970343a8b7dc534e78fd25a3_SeqId_12_ - updating store file list. 2023-11-21 13:54:15,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/75f92c84970343a8b7dc534e78fd25a3_SeqId_12_ into 7f56f11b9f2883e62033f7f9de924a85/family1 2023-11-21 13:54:15,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testScannerOnBulkLoadRefHFiles__jl79eh1db9r9bml1jq4cs0oij1fvbbpdklr1n3kg4hi5nmtjr891du80837a3a5q/family1/06ceb2acd1604f99b0b4eea31a7e6cdc into 7f56f11b9f2883e62033f7f9de924a85/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/75f92c84970343a8b7dc534e78fd25a3_SeqId_12_) 2023-11-21 13:54:15,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testScannerOnBulkLoadRefHFiles__jl79eh1db9r9bml1jq4cs0oij1fvbbpdklr1n3kg4hi5nmtjr891du80837a3a5q/family1/06ceb2acd1604f99b0b4eea31a7e6cdc 2023-11-21 13:54:15,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-21 13:54:15,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-21 13:54:15,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(1912): 7f56f11b9f2883e62033f7f9de924a85/family1 is initiating minor compaction (all files) 2023-11-21 13:54:15,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5de6cb29; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:54:15,550 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7f56f11b9f2883e62033f7f9de924a85/family1 in testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. 2023-11-21 13:54:15,550 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/87249eb2650a4d38a5263882c3b5b9f1, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/1811f1028f594779a16054cd078292ce, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/75f92c84970343a8b7dc534e78fd25a3_SeqId_12_] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/.tmp, totalSize=15.1 K 2023-11-21 13:54:15,551 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 87249eb2650a4d38a5263882c3b5b9f1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574852715 2023-11-21 13:54:15,551 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 1811f1028f594779a16054cd078292ce, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574852715 2023-11-21 13:54:15,552 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 75f92c84970343a8b7dc534e78fd25a3_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574852715 2023-11-21 13:54:15,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231121 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-21 13:54:15,553 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:15,554 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311219dee4d614fdc49c6890ad16c1540abee to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311219dee4d614fdc49c6890ad16c1540abee 2023-11-21 13:54:15,556 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231121addeca27d39f490da0bb89519f8a704b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231121addeca27d39f490da0bb89519f8a704b 2023-11-21 13:54:15,556 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-21 13:54:15,556 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231121' 2023-11-21 13:54:15,556 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231121 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-21 13:54:15,556 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-21 13:54:15,556 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:54:15,557 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-21 13:54:15,558 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 897 msec 2023-11-21 13:54:15,562 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7f56f11b9f2883e62033f7f9de924a85#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:54:15,589 INFO [Listener at localhost/35077] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=260 (was 264), OpenFileDescriptor=649 (was 653), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=247 (was 269), ProcessCount=174 (was 174), AvailableMemoryMB=7043 (was 7084) 2023-11-21 13:54:15,600 INFO [Listener at localhost/35077] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=260, OpenFileDescriptor=649, MaxFileDescriptor=60000, SystemLoadAverage=247, ProcessCount=174, AvailableMemoryMB=7042 2023-11-21 13:54:15,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-21 13:54:15,623 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-21 13:54:15,623 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x589356ff to 127.0.0.1:52369 2023-11-21 13:54:15,623 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:54:15,624 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-21 13:54:15,624 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d577689 to 127.0.0.1:52369 2023-11-21 13:54:15,624 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:54:15,624 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-21 13:54:15,624 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x632c336c to 127.0.0.1:52369 2023-11-21 13:54:15,624 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:54:15,625 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-21 13:54:15,625 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0790c8fc to 127.0.0.1:52369 2023-11-21 13:54:15,625 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:54:15,625 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-21 13:54:15,625 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c080524 to 127.0.0.1:52369 2023-11-21 13:54:15,625 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:54:15,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:15,628 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-21 13:54:15,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-21 13:54:15,629 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-21 13:54:15,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-21 13:54:15,631 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca 2023-11-21 13:54:15,631 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca empty. 2023-11-21 13:54:15,632 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca 2023-11-21 13:54:15,632 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-21 13:54:15,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-21 13:54:15,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-21 13:54:16,045 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-21 13:54:16,046 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => e005e724571afdd7b19c1242ce731aca, NAME => 'testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:54:16,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-21 13:54:16,452 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:54:16,453 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing e005e724571afdd7b19c1242ce731aca, disabling compactions & flushes 2023-11-21 13:54:16,453 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:16,453 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:16,453 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. after waiting 0 ms 2023-11-21 13:54:16,453 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:16,453 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:16,453 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for e005e724571afdd7b19c1242ce731aca: 2023-11-21 13:54:16,455 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-21 13:54:16,456 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700574856456"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574856456"}]},"ts":"1700574856456"} 2023-11-21 13:54:16,457 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-21 13:54:16,458 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-21 13:54:16,458 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574856458"}]},"ts":"1700574856458"} 2023-11-21 13:54:16,459 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-21 13:54:16,463 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e005e724571afdd7b19c1242ce731aca, ASSIGN}] 2023-11-21 13:54:16,464 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e005e724571afdd7b19c1242ce731aca, ASSIGN 2023-11-21 13:54:16,465 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e005e724571afdd7b19c1242ce731aca, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:54:16,616 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e005e724571afdd7b19c1242ce731aca, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:16,616 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700574856615"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574856615"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574856615"}]},"ts":"1700574856615"} 2023-11-21 13:54:16,618 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure e005e724571afdd7b19c1242ce731aca, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:54:16,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-21 13:54:16,769 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:16,772 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:16,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e005e724571afdd7b19c1242ce731aca, NAME => 'testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca.', STARTKEY => '', ENDKEY => ''} 2023-11-21 13:54:16,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy e005e724571afdd7b19c1242ce731aca 2023-11-21 13:54:16,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:54:16,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for e005e724571afdd7b19c1242ce731aca 2023-11-21 13:54:16,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for e005e724571afdd7b19c1242ce731aca 2023-11-21 13:54:16,774 INFO [StoreOpener-e005e724571afdd7b19c1242ce731aca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e005e724571afdd7b19c1242ce731aca 2023-11-21 13:54:16,776 DEBUG [StoreOpener-e005e724571afdd7b19c1242ce731aca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1 2023-11-21 13:54:16,776 DEBUG [StoreOpener-e005e724571afdd7b19c1242ce731aca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1 2023-11-21 13:54:16,777 INFO [StoreOpener-e005e724571afdd7b19c1242ce731aca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e005e724571afdd7b19c1242ce731aca columnFamilyName family1 2023-11-21 13:54:16,778 INFO [StoreOpener-e005e724571afdd7b19c1242ce731aca-1] regionserver.HStore(310): Store=e005e724571afdd7b19c1242ce731aca/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:54:16,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca 2023-11-21 13:54:16,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca 2023-11-21 13:54:16,782 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/.tmp/family1/043c325d555641c58cc79fb4ceb44f62 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/043c325d555641c58cc79fb4ceb44f62 2023-11-21 13:54:16,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for e005e724571afdd7b19c1242ce731aca 2023-11-21 13:54:16,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:54:16,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened e005e724571afdd7b19c1242ce731aca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59471687, jitterRate=-0.11380280554294586}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-21 13:54:16,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for e005e724571afdd7b19c1242ce731aca: 2023-11-21 13:54:16,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca., pid=37, masterSystemTime=1700574856769 2023-11-21 13:54:16,788 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 7f56f11b9f2883e62033f7f9de924a85/family1 of 7f56f11b9f2883e62033f7f9de924a85 into 043c325d555641c58cc79fb4ceb44f62(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-21 13:54:16,788 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7f56f11b9f2883e62033f7f9de924a85: 2023-11-21 13:54:16,789 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1700574855550; duration=1sec 2023-11-21 13:54:16,789 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:54:16,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:16,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:16,789 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e005e724571afdd7b19c1242ce731aca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:16,790 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700574856789"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574856789"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574856789"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574856789"}]},"ts":"1700574856789"} 2023-11-21 13:54:16,794 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=37, resume processing ppid=36 2023-11-21 13:54:16,794 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure e005e724571afdd7b19c1242ce731aca, server=jenkins-hbase6.apache.org,46365,1700574804408 in 173 msec 2023-11-21 13:54:16,796 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/87249eb2650a4d38a5263882c3b5b9f1, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/1811f1028f594779a16054cd078292ce, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/75f92c84970343a8b7dc534e78fd25a3_SeqId_12_] to archive 2023-11-21 13:54:16,797 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:16,797 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=36, resume processing ppid=35 2023-11-21 13:54:16,797 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e005e724571afdd7b19c1242ce731aca, ASSIGN in 331 msec 2023-11-21 13:54:16,798 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-21 13:54:16,798 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574856798"}]},"ts":"1700574856798"} 2023-11-21 13:54:16,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/87249eb2650a4d38a5263882c3b5b9f1 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/87249eb2650a4d38a5263882c3b5b9f1 2023-11-21 13:54:16,799 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-21 13:54:16,800 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/1811f1028f594779a16054cd078292ce to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/1811f1028f594779a16054cd078292ce 2023-11-21 13:54:16,801 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/75f92c84970343a8b7dc534e78fd25a3_SeqId_12_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/family1/75f92c84970343a8b7dc534e78fd25a3_SeqId_12_ 2023-11-21 13:54:16,802 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-21 13:54:16,803 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1790 sec 2023-11-21 13:54:17,292 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-21 13:54:17,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-21 13:54:17,735 INFO [Listener at localhost/35077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-21 13:54:17,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:17,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:17,758 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:17,758 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:17,758 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:17,758 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:17,759 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:17,759 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:17,762 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:17,762 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:17,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:17,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:17,762 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:17,762 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:17,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:17,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:17,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:17,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:17,763 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:17,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:17,764 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:17,764 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:17,764 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:17,764 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:17,764 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:17,764 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:17,764 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. started... 2023-11-21 13:54:17,765 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e005e724571afdd7b19c1242ce731aca 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-21 13:54:18,183 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301e2b95a4ce1a49f18beb02aa9887099e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511301e2b95a4ce1a49f18beb02aa9887099e 2023-11-21 13:54:18,587 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/a59de11af83f44fa83783a31a1fa81a3 2023-11-21 13:54:18,592 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/a59de11af83f44fa83783a31a1fa81a3 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/a59de11af83f44fa83783a31a1fa81a3 2023-11-21 13:54:18,596 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/a59de11af83f44fa83783a31a1fa81a3, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-21 13:54:18,597 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e005e724571afdd7b19c1242ce731aca in 832ms, sequenceid=5, compaction requested=false 2023-11-21 13:54:18,597 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:18,597 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e005e724571afdd7b19c1242ce731aca: 2023-11-21 13:54:18,597 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:18,598 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:18,598 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:18,598 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:18,598 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:18,598 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:18,599 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:18,599 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:18,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:18,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:18,600 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,600 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:18,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:18,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:18,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:18,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:18,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:18,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f248a7e[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:18,601 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:18,601 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,603 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,603 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:18,603 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:18,603 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:18,603 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:18,603 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:18,604 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:18,604 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:18,604 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:18,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:18,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:18,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:18,604 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:18,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:18,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:18,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:18,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:18,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:18,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:18,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:18,607 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:18,607 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:18,607 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:18,607 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,607 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:18,610 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,610 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:18,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:18,610 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:18,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:18,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:18,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:18,611 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:18,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:18,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:18,612 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:18,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:18,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:18,615 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:18,615 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:18,615 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:18,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:18,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:18,615 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:18,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:18,615 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:18,615 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,615 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:18,615 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,615 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:18,615 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,616 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:18,616 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:18,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:18,716 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:18,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:18,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:18,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:18,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,722 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:18,722 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:18,722 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:18,722 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:18,723 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,723 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,724 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:18,724 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:18,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:18,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:18,724 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:18,724 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:18,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,725 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:18,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,725 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,725 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-21 13:54:18,725 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:18,725 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:18,725 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:18,725 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:18,726 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:18,726 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:18,726 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:18,726 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. started... 2023-11-21 13:54:18,726 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e005e724571afdd7b19c1242ce731aca 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-21 13:54:19,138 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a4aa94263c8240979cb2e88ccae5152e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128a4aa94263c8240979cb2e88ccae5152e 2023-11-21 13:54:19,544 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/125d2fc1b26242c5ac33936e289316bc 2023-11-21 13:54:19,549 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/125d2fc1b26242c5ac33936e289316bc as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/125d2fc1b26242c5ac33936e289316bc 2023-11-21 13:54:19,553 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/125d2fc1b26242c5ac33936e289316bc, entries=1, sequenceid=9, filesize=5.0 K 2023-11-21 13:54:19,554 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e005e724571afdd7b19c1242ce731aca in 828ms, sequenceid=9, compaction requested=false 2023-11-21 13:54:19,554 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e005e724571afdd7b19c1242ce731aca: 2023-11-21 13:54:19,554 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:19,554 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:19,554 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:19,554 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:19,554 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:19,554 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:19,556 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,556 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:19,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:19,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:19,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:19,557 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,557 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:19,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:19,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:19,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:19,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:19,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:19,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6794e605[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:19,558 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:19,558 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,561 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,561 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:19,561 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:19,561 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:19,561 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:19,561 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:19,562 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:19,563 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:19,562 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:19,563 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:19,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:19,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:19,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:19,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:19,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:19,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:19,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:19,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:19,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:19,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:19,565 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:19,565 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:19,565 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:19,565 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,565 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:19,567 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,567 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:19,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:19,567 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:19,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:19,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:19,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:19,568 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:19,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:19,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:19,569 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:19,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:19,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:19,579 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:19,580 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:19,580 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:19,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:19,580 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:19,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:19,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:19,580 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:19,580 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,580 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:19,580 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:19,580 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:19,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:19,580 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,580 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:19,580 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,680 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:19,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:19,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:19,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:19,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,687 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:19,687 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:19,687 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:19,687 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:19,687 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,687 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,689 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:19,689 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:19,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:19,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:19,689 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:19,689 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:19,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:19,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,690 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,690 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-21 13:54:19,690 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:19,691 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:19,691 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:19,691 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:19,691 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:19,691 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:19,691 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:19,691 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. started... 2023-11-21 13:54:19,691 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e005e724571afdd7b19c1242ce731aca 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:20,103 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512019895657891574d208b3f45b85c8e6f6d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512019895657891574d208b3f45b85c8e6f6d 2023-11-21 13:54:20,508 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/eeca270783b346db813a092a1ab97477 2023-11-21 13:54:20,513 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/eeca270783b346db813a092a1ab97477 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/eeca270783b346db813a092a1ab97477 2023-11-21 13:54:20,517 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/eeca270783b346db813a092a1ab97477, entries=1, sequenceid=13, filesize=4.9 K 2023-11-21 13:54:20,518 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e005e724571afdd7b19c1242ce731aca in 827ms, sequenceid=13, compaction requested=true 2023-11-21 13:54:20,518 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e005e724571afdd7b19c1242ce731aca: 2023-11-21 13:54:20,518 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:20,519 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:20,519 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:20,519 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:20,519 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:20,519 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:20,520 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:20,520 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:20,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:20,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:20,521 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,521 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:20,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:20,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:20,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:20,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:20,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:20,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@649be8e[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:20,522 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:20,522 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,524 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,524 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:20,524 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:20,524 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:20,524 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:20,524 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:20,526 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:20,526 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:20,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:20,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:20,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:20,526 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:20,526 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:20,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:20,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:20,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:20,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:20,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:20,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:20,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:20,529 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:20,529 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:20,529 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:20,529 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,529 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:20,531 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,531 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:20,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:20,531 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:20,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:20,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:20,531 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:20,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:20,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:20,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:20,533 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:20,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:20,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:20,535 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:20,535 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:20,535 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,535 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:20,535 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:20,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:20,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:20,535 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:20,535 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:20,535 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:20,535 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:20,536 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:20,535 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,536 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:20,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:20,636 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:20,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:20,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:20,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:20,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,642 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:20,642 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:20,642 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:20,642 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:20,642 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,642 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,644 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:20,644 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:20,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:20,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:20,644 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:20,644 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:20,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,644 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:20,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,645 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,645 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-21 13:54:20,645 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:20,645 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:20,645 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:20,645 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:20,645 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:20,645 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:20,645 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:20,645 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. started... 2023-11-21 13:54:20,646 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e005e724571afdd7b19c1242ce731aca 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:21,058 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ee14624839df48cb98b0724deb738e8d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205ee14624839df48cb98b0724deb738e8d 2023-11-21 13:54:21,464 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/e3f92346438f438caacf10a8c844be7b 2023-11-21 13:54:21,469 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/e3f92346438f438caacf10a8c844be7b as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/e3f92346438f438caacf10a8c844be7b 2023-11-21 13:54:21,473 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/e3f92346438f438caacf10a8c844be7b, entries=1, sequenceid=17, filesize=4.9 K 2023-11-21 13:54:21,473 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e005e724571afdd7b19c1242ce731aca in 827ms, sequenceid=17, compaction requested=true 2023-11-21 13:54:21,474 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e005e724571afdd7b19c1242ce731aca: 2023-11-21 13:54:21,474 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:21,474 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:21,474 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:21,474 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:21,474 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:21,474 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:21,476 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:21,476 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:21,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:21,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:21,477 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,477 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:21,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:21,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:21,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:21,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:21,478 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:21,478 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39ed8641[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:21,478 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:21,478 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,479 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,480 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:21,480 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:21,480 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:21,480 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:21,480 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:21,481 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:21,481 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:21,481 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:21,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:21,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:21,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:21,481 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:21,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:21,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:21,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:21,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:21,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:21,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:21,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:21,484 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:21,484 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:21,484 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:21,484 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,484 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:21,486 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,486 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:21,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:21,486 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:21,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:21,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:21,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:21,486 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:21,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:21,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:21,488 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:21,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:21,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:21,491 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:21,491 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:21,491 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:21,491 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:21,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:21,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:21,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:21,491 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,491 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:21,491 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:21,492 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,492 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,492 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:21,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:21,492 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:21,492 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:21,592 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:21,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:21,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:21,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:21,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,598 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:21,598 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:21,598 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:21,598 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:21,598 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,598 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,600 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:21,600 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:21,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:21,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:21,600 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:21,600 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:21,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:21,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,601 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,601 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-21 13:54:21,601 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:21,601 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:21,601 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:21,601 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:21,601 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:21,601 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:21,602 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:21,602 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. started... 2023-11-21 13:54:21,602 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e005e724571afdd7b19c1242ce731aca 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:22,014 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228555286ca428e48edba19c3140e0f7a78 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228555286ca428e48edba19c3140e0f7a78 2023-11-21 13:54:22,275 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-21 13:54:22,419 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/60392b0be1454793a696ed87673e2bf6 2023-11-21 13:54:22,424 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/60392b0be1454793a696ed87673e2bf6 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/60392b0be1454793a696ed87673e2bf6 2023-11-21 13:54:22,428 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/60392b0be1454793a696ed87673e2bf6, entries=1, sequenceid=21, filesize=4.9 K 2023-11-21 13:54:22,429 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e005e724571afdd7b19c1242ce731aca in 827ms, sequenceid=21, compaction requested=true 2023-11-21 13:54:22,429 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e005e724571afdd7b19c1242ce731aca: 2023-11-21 13:54:22,429 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:22,429 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:22,429 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:22,429 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:22,429 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:22,429 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:22,431 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:22,431 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:22,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:22,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:22,432 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,432 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:22,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:22,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:22,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:22,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:22,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:22,433 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:22,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72d19c78[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:22,433 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,434 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,435 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:22,435 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:22,435 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:22,435 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:22,435 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:22,437 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:22,437 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:22,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:22,437 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:22,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:22,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:22,437 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:22,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:22,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:22,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:22,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:22,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:22,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:22,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:22,439 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:22,440 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:22,440 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:22,440 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,440 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:22,444 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,444 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,444 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:22,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:22,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:22,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:22,445 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:22,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:22,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:22,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:22,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,446 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:22,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:22,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:22,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:22,449 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:22,449 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,449 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,449 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:22,449 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:22,449 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:22,449 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:22,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:22,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:22,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:22,449 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:22,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-21 13:54:22,449 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,449 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:22,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:22,450 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:22,449 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:22,550 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:22,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:22,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:22,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:22,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,556 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:22,556 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:22,556 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:22,556 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:22,556 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,556 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,559 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:22,559 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:22,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:22,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:22,559 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:22,559 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:22,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:22,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,560 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,560 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-21 13:54:22,560 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:22,560 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:22,560 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:22,560 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:22,561 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:22,561 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:22,561 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:22,561 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. started... 2023-11-21 13:54:22,561 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e005e724571afdd7b19c1242ce731aca 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:22,973 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231056848223aae43759d295227b83374ee to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231056848223aae43759d295227b83374ee 2023-11-21 13:54:23,379 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/31097f7f672e45c086a6e38510d72cdb 2023-11-21 13:54:23,383 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/31097f7f672e45c086a6e38510d72cdb as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/31097f7f672e45c086a6e38510d72cdb 2023-11-21 13:54:23,388 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/31097f7f672e45c086a6e38510d72cdb, entries=1, sequenceid=25, filesize=4.9 K 2023-11-21 13:54:23,388 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e005e724571afdd7b19c1242ce731aca in 827ms, sequenceid=25, compaction requested=true 2023-11-21 13:54:23,388 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e005e724571afdd7b19c1242ce731aca: 2023-11-21 13:54:23,389 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:23,389 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:23,389 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:23,389 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:23,389 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:23,389 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:23,390 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,391 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:23,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:23,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:23,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:23,391 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,391 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:23,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:23,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:23,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:23,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:23,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:23,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32b5e8e9[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:23,392 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:23,392 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,394 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,394 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:23,394 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:23,394 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:23,394 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:23,394 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:23,395 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:23,395 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:23,396 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:23,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:23,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:23,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:23,396 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:23,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:23,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:23,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:23,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:23,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:23,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:23,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:23,398 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:23,398 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:23,398 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:23,398 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,398 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:23,401 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,401 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:23,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:23,401 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:23,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:23,401 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:23,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:23,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:23,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:23,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,403 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:23,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:23,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:23,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:23,405 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:23,405 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,405 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,405 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:23,405 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,405 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,405 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,405 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:23,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:23,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:23,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:23,405 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:23,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:23,405 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:23,406 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:23,406 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:23,406 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-21 13:54:23,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:23,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:23,506 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:23,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:23,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:23,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:23,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,512 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:23,512 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:23,512 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:23,512 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:23,513 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,513 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,514 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:23,514 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:23,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:23,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:23,514 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:23,514 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:23,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:23,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,515 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,516 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-21 13:54:23,516 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:23,516 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:23,516 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:23,516 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:23,516 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:23,516 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:23,516 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:23,516 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. started... 2023-11-21 13:54:23,516 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e005e724571afdd7b19c1242ce731aca 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:23,933 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601015f2c78ce632d427c820e779aad04d54d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601015f2c78ce632d427c820e779aad04d54d 2023-11-21 13:54:24,338 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/24b607f3851e4e4084bacdfc9627e5cb 2023-11-21 13:54:24,343 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/24b607f3851e4e4084bacdfc9627e5cb as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/24b607f3851e4e4084bacdfc9627e5cb 2023-11-21 13:54:24,347 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/24b607f3851e4e4084bacdfc9627e5cb, entries=1, sequenceid=29, filesize=4.9 K 2023-11-21 13:54:24,348 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e005e724571afdd7b19c1242ce731aca in 832ms, sequenceid=29, compaction requested=true 2023-11-21 13:54:24,348 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e005e724571afdd7b19c1242ce731aca: 2023-11-21 13:54:24,348 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:24,348 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:24,348 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:24,348 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:24,348 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:24,348 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:24,350 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:24,350 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:24,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:24,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:24,350 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:24,350 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:24,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:24,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:24,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:24,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:24,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79439dff[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:24,352 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:24,352 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,354 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,354 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:24,354 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:24,354 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:24,354 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:24,354 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:24,355 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:24,355 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:24,355 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:24,355 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:24,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:24,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:24,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:24,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:24,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:24,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:24,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:24,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:24,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:24,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:24,358 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:24,358 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:24,358 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:24,358 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,358 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:24,359 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,359 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:24,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:24,359 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:24,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:24,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:24,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:24,360 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:24,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:24,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,361 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:24,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:24,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:24,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:24,363 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:24,363 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,363 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,363 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:24,363 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,363 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,364 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,364 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:24,363 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:24,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-21 13:54:24,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:24,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:24,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:24,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:24,364 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:24,364 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:24,364 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:24,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:24,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:24,464 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:24,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:24,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:24,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:24,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,470 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:24,470 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:24,470 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:24,470 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:24,470 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,470 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,473 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:24,473 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:24,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:24,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:24,473 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:24,473 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:24,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,473 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:24,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,474 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,474 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-21 13:54:24,474 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:24,474 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:24,474 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:24,474 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:24,474 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:24,474 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:24,474 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:24,474 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. started... 2023-11-21 13:54:24,474 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e005e724571afdd7b19c1242ce731aca 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:24,887 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103654b4e57777740a08021fbfa753bb8dc to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103654b4e57777740a08021fbfa753bb8dc 2023-11-21 13:54:25,292 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/955792229919445da593b13fcf86c98f 2023-11-21 13:54:25,297 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/955792229919445da593b13fcf86c98f as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/955792229919445da593b13fcf86c98f 2023-11-21 13:54:25,301 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/955792229919445da593b13fcf86c98f, entries=1, sequenceid=33, filesize=4.9 K 2023-11-21 13:54:25,302 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e005e724571afdd7b19c1242ce731aca in 828ms, sequenceid=33, compaction requested=true 2023-11-21 13:54:25,302 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e005e724571afdd7b19c1242ce731aca: 2023-11-21 13:54:25,302 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:25,302 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:25,302 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:25,302 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:25,302 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:25,302 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:25,307 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,307 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:25,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:25,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:25,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:25,307 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,307 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:25,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:25,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:25,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:25,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:25,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:25,309 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:25,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c49c318[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:25,309 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,310 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,310 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:25,310 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:25,310 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:25,310 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:25,310 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:25,313 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:25,313 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:25,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:25,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:25,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:25,313 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:25,313 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:25,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:25,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:25,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:25,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:25,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:25,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:25,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:25,315 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:25,315 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:25,315 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:25,315 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,315 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:25,317 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,317 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,317 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:25,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:25,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:25,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:25,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:25,317 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:25,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:25,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:25,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:25,321 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:25,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:25,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:25,324 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:25,324 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,324 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:25,324 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,324 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:25,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:25,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:25,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:25,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:25,324 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:25,324 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:25,324 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,324 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,324 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:25,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:25,324 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:25,325 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:25,425 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:25,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:25,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:25,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:25,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,431 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:25,431 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:25,431 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:25,431 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:25,431 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,431 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,433 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:25,433 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:25,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:25,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:25,433 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:25,433 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:25,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:25,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,434 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,434 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-21 13:54:25,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:25,434 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:25,434 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:25,434 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:25,434 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:25,434 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:25,434 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:25,434 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. started... 2023-11-21 13:54:25,434 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e005e724571afdd7b19c1242ce731aca 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:25,686 DEBUG [regionserver/jenkins-hbase6:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.38461538461538464, tune throughput to 69.23 MB/second 2023-11-21 13:54:25,848 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074ca0b644a8da4db7b0db196e3efac159 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509074ca0b644a8da4db7b0db196e3efac159 2023-11-21 13:54:26,253 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/6e4229c2e56b4331903854f422bfad97 2023-11-21 13:54:26,258 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/6e4229c2e56b4331903854f422bfad97 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/6e4229c2e56b4331903854f422bfad97 2023-11-21 13:54:26,261 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/6e4229c2e56b4331903854f422bfad97, entries=1, sequenceid=37, filesize=4.9 K 2023-11-21 13:54:26,262 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e005e724571afdd7b19c1242ce731aca in 828ms, sequenceid=37, compaction requested=true 2023-11-21 13:54:26,262 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e005e724571afdd7b19c1242ce731aca: 2023-11-21 13:54:26,262 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:26,263 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:26,263 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:26,263 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:26,263 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:26,263 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:26,264 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:26,265 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:26,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:26,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:26,265 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:26,265 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:26,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:26,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:26,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:26,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:26,267 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:26,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5205b8b5[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:26,267 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,270 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,270 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:26,270 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:26,270 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:26,270 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:26,270 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:26,271 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:26,271 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:26,271 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:26,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:26,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:26,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:26,271 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:26,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:26,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:26,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:26,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:26,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:26,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:26,274 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:26,274 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:26,274 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:26,274 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:26,274 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,274 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:26,276 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,276 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:26,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:26,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,276 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:26,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:26,277 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:26,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:26,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:26,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:26,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,278 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:26,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:26,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:26,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:26,280 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:26,280 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,280 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:26,280 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,280 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:26,280 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:26,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-21 13:54:26,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:26,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:26,280 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:26,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:26,281 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:26,281 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,281 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,281 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:26,281 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:26,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:26,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:26,381 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:26,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:26,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:26,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:26,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,387 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:26,387 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:26,387 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-21 13:54:26,387 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-21 13:54:26,388 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,388 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,390 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:26,390 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:26,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:26,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:26,391 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:26,391 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:26,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:26,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,391 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,391 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-21 13:54:26,391 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:26,392 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-21 13:54:26,392 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:26,392 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-21 13:54:26,392 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:26,392 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:26,392 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:26,392 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. started... 2023-11-21 13:54:26,392 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e005e724571afdd7b19c1242ce731aca 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:26,805 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511200c109534bb494342ad6ec5142a9e38a9 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511200c109534bb494342ad6ec5142a9e38a9 2023-11-21 13:54:27,210 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/1c3f849a51ca4f3c833e9fea26c1608a 2023-11-21 13:54:27,215 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/1c3f849a51ca4f3c833e9fea26c1608a as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/1c3f849a51ca4f3c833e9fea26c1608a 2023-11-21 13:54:27,219 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/1c3f849a51ca4f3c833e9fea26c1608a, entries=1, sequenceid=41, filesize=4.9 K 2023-11-21 13:54:27,220 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e005e724571afdd7b19c1242ce731aca in 828ms, sequenceid=41, compaction requested=true 2023-11-21 13:54:27,220 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e005e724571afdd7b19c1242ce731aca: 2023-11-21 13:54:27,220 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:27,220 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:27,220 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:27,220 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:27,220 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-21 13:54:27,220 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-21 13:54:27,222 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:27,222 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:27,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:27,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:27,222 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,222 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:27,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:27,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:27,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:27,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:27,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-21 13:54:27,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f6af0bc[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:27,223 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-21 13:54:27,224 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,225 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,225 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-21 13:54:27,225 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-21 13:54:27,225 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:27,225 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:27,225 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:27,226 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:27,226 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-21 13:54:27,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:27,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:27,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:27,226 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:27,226 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-21 13:54:27,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:27,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:27,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:27,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:27,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:27,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:27,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:54:27,228 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-21 13:54:27,228 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:27,229 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:27,229 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,229 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:27,231 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,231 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:27,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:27,231 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:27,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:27,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:27,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:27,231 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:27,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:27,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:27,233 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:27,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:27,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:27,238 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:27,238 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,238 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:27,238 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,238 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:27,238 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:27,238 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:27,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-21 13:54:27,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:27,238 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:27,238 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:27,238 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,238 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:27,238 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:27,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:27,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:27,338 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:27,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:27,340 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43219] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-21 13:54:27,342 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-21 13:54:27,342 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-21 13:54:27,343 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:54:27,343 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700575467343 2023-11-21 13:54:27,344 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-21 13:54:27,345 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-21 13:54:27,345 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-21 13:54:27,347 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] zookeeper.ReadOnlyZKClient(139): Connect 0x1aa8a9d1 to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:54:27,350 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25a963fb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:54:27,351 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:28,191 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010392bcdb18f7844977b00f44917dbc476e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010392bcdb18f7844977b00f44917dbc476e 2023-11-21 13:54:28,193 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-21 13:54:28,205 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:54:28,206 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:53392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:54:28,212 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-21 13:54:28,213 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:53120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-21 13:54:28,222 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6b92f826317a4b8eb46f14bfeba67ac3 first=Optional[r3] last=Optional[r6] 2023-11-21 13:54:28,222 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6b92f826317a4b8eb46f14bfeba67ac3}] 2023-11-21 13:54:28,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6b92f826317a4b8eb46f14bfeba67ac3 for inclusion in e005e724571afdd7b19c1242ce731aca/family1 2023-11-21 13:54:28,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-21 13:54:28,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:54:28,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for e005e724571afdd7b19c1242ce731aca: 2023-11-21 13:54:28,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6b92f826317a4b8eb46f14bfeba67ac3 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cphqdav4pmlqks9hs13psn007en6vjcugmll3231u337sl72e1mq38slnklbplvk/family1/6b92f826317a4b8eb46f14bfeba67ac3 2023-11-21 13:54:28,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cphqdav4pmlqks9hs13psn007en6vjcugmll3231u337sl72e1mq38slnklbplvk/family1/6b92f826317a4b8eb46f14bfeba67ac3 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/ab35631f0d16434cabbe66b08e19c723_SeqId_44_ 2023-11-21 13:54:28,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cphqdav4pmlqks9hs13psn007en6vjcugmll3231u337sl72e1mq38slnklbplvk/family1/6b92f826317a4b8eb46f14bfeba67ac3 into e005e724571afdd7b19c1242ce731aca/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/ab35631f0d16434cabbe66b08e19c723_SeqId_44_ - updating store file list. 2023-11-21 13:54:28,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/ab35631f0d16434cabbe66b08e19c723_SeqId_44_ into e005e724571afdd7b19c1242ce731aca/family1 2023-11-21 13:54:28,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cphqdav4pmlqks9hs13psn007en6vjcugmll3231u337sl72e1mq38slnklbplvk/family1/6b92f826317a4b8eb46f14bfeba67ac3 into e005e724571afdd7b19c1242ce731aca/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/ab35631f0d16434cabbe66b08e19c723_SeqId_44_) 2023-11-21 13:54:28,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cphqdav4pmlqks9hs13psn007en6vjcugmll3231u337sl72e1mq38slnklbplvk/family1/6b92f826317a4b8eb46f14bfeba67ac3 2023-11-21 13:54:28,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-21 13:54:28,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-21 13:54:28,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(1912): e005e724571afdd7b19c1242ce731aca/family1 is initiating minor compaction 2023-11-21 13:54:28,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@79c556f7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:54:28,240 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e005e724571afdd7b19c1242ce731aca/family1 in testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:28,240 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/125d2fc1b26242c5ac33936e289316bc, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/eeca270783b346db813a092a1ab97477, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/e3f92346438f438caacf10a8c844be7b, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/60392b0be1454793a696ed87673e2bf6, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/31097f7f672e45c086a6e38510d72cdb, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/24b607f3851e4e4084bacdfc9627e5cb, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/955792229919445da593b13fcf86c98f, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/6e4229c2e56b4331903854f422bfad97, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/1c3f849a51ca4f3c833e9fea26c1608a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/ab35631f0d16434cabbe66b08e19c723_SeqId_44_] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp, totalSize=50.0 K 2023-11-21 13:54:28,240 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 125d2fc1b26242c5ac33936e289316bc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-21 13:54:28,240 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting eeca270783b346db813a092a1ab97477, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-21 13:54:28,240 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting e3f92346438f438caacf10a8c844be7b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-21 13:54:28,240 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 60392b0be1454793a696ed87673e2bf6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-21 13:54:28,240 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 31097f7f672e45c086a6e38510d72cdb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-21 13:54:28,240 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 24b607f3851e4e4084bacdfc9627e5cb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-21 13:54:28,240 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 955792229919445da593b13fcf86c98f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-21 13:54:28,240 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 6e4229c2e56b4331903854f422bfad97, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-21 13:54:28,240 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 1c3f849a51ca4f3c833e9fea26c1608a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-21 13:54:28,241 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting ab35631f0d16434cabbe66b08e19c723_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-21 13:54:28,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-21 13:54:28,242 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:28,244 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228555286ca428e48edba19c3140e0f7a78 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228555286ca428e48edba19c3140e0f7a78 2023-11-21 13:54:28,245 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231056848223aae43759d295227b83374ee to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231056848223aae43759d295227b83374ee 2023-11-21 13:54:28,246 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601015f2c78ce632d427c820e779aad04d54d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601015f2c78ce632d427c820e779aad04d54d 2023-11-21 13:54:28,248 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103654b4e57777740a08021fbfa753bb8dc to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103654b4e57777740a08021fbfa753bb8dc 2023-11-21 13:54:28,248 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-21 13:54:28,248 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-21 13:54:28,248 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:28,248 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:28,249 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:28,249 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:28,249 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:28,249 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:28,249 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:28,249 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:28,277 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): e005e724571afdd7b19c1242ce731aca#family1#compaction#49 average throughput is 1.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-21 13:54:28,698 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/f51a74ac0dfe4210b240f49bbdf5b5aa as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/f51a74ac0dfe4210b240f49bbdf5b5aa 2023-11-21 13:54:28,702 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e005e724571afdd7b19c1242ce731aca/family1 of e005e724571afdd7b19c1242ce731aca into f51a74ac0dfe4210b240f49bbdf5b5aa(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:54:28,702 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e005e724571afdd7b19c1242ce731aca: 2023-11-21 13:54:28,703 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1700574868239; duration=0sec 2023-11-21 13:54:28,703 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:54:28,803 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/125d2fc1b26242c5ac33936e289316bc, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/eeca270783b346db813a092a1ab97477, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/e3f92346438f438caacf10a8c844be7b, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/60392b0be1454793a696ed87673e2bf6, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/31097f7f672e45c086a6e38510d72cdb, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/24b607f3851e4e4084bacdfc9627e5cb, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/955792229919445da593b13fcf86c98f, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/6e4229c2e56b4331903854f422bfad97, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/1c3f849a51ca4f3c833e9fea26c1608a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/ab35631f0d16434cabbe66b08e19c723_SeqId_44_] to archive 2023-11-21 13:54:28,804 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:28,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/125d2fc1b26242c5ac33936e289316bc to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/125d2fc1b26242c5ac33936e289316bc 2023-11-21 13:54:28,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/eeca270783b346db813a092a1ab97477 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/eeca270783b346db813a092a1ab97477 2023-11-21 13:54:28,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/e3f92346438f438caacf10a8c844be7b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/e3f92346438f438caacf10a8c844be7b 2023-11-21 13:54:28,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/60392b0be1454793a696ed87673e2bf6 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/60392b0be1454793a696ed87673e2bf6 2023-11-21 13:54:28,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/31097f7f672e45c086a6e38510d72cdb to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/31097f7f672e45c086a6e38510d72cdb 2023-11-21 13:54:28,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/24b607f3851e4e4084bacdfc9627e5cb to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/24b607f3851e4e4084bacdfc9627e5cb 2023-11-21 13:54:28,812 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/955792229919445da593b13fcf86c98f to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/955792229919445da593b13fcf86c98f 2023-11-21 13:54:28,813 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/6e4229c2e56b4331903854f422bfad97 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/6e4229c2e56b4331903854f422bfad97 2023-11-21 13:54:28,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/1c3f849a51ca4f3c833e9fea26c1608a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/1c3f849a51ca4f3c833e9fea26c1608a 2023-11-21 13:54:28,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/ab35631f0d16434cabbe66b08e19c723_SeqId_44_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/ab35631f0d16434cabbe66b08e19c723_SeqId_44_ 2023-11-21 13:54:29,111 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c21ebf3a93f14d559c950037a2c21efb to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205c21ebf3a93f14d559c950037a2c21efb 2023-11-21 13:54:29,112 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-21 13:54:29,137 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/34059151d53441f483fc8fc17d7b0a66 first=Optional[r00] last=Optional[r2] 2023-11-21 13:54:29,137 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/34059151d53441f483fc8fc17d7b0a66}] 2023-11-21 13:54:29,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/34059151d53441f483fc8fc17d7b0a66 for inclusion in e005e724571afdd7b19c1242ce731aca/family1 2023-11-21 13:54:29,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-21 13:54:29,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:54:29,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for e005e724571afdd7b19c1242ce731aca: 2023-11-21 13:54:29,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/34059151d53441f483fc8fc17d7b0a66 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__hd8u0h7eajieivb7srhd3bv1ha319gh2libbj634ft9ihl6amappq4ouj153jeem/family1/34059151d53441f483fc8fc17d7b0a66 2023-11-21 13:54:29,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__hd8u0h7eajieivb7srhd3bv1ha319gh2libbj634ft9ihl6amappq4ouj153jeem/family1/34059151d53441f483fc8fc17d7b0a66 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/d05bb3dace2a49b79faad514945b84d8_SeqId_47_ 2023-11-21 13:54:29,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__hd8u0h7eajieivb7srhd3bv1ha319gh2libbj634ft9ihl6amappq4ouj153jeem/family1/34059151d53441f483fc8fc17d7b0a66 into e005e724571afdd7b19c1242ce731aca/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/d05bb3dace2a49b79faad514945b84d8_SeqId_47_ - updating store file list. 2023-11-21 13:54:29,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/d05bb3dace2a49b79faad514945b84d8_SeqId_47_ into e005e724571afdd7b19c1242ce731aca/family1 2023-11-21 13:54:29,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__hd8u0h7eajieivb7srhd3bv1ha319gh2libbj634ft9ihl6amappq4ouj153jeem/family1/34059151d53441f483fc8fc17d7b0a66 into e005e724571afdd7b19c1242ce731aca/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/d05bb3dace2a49b79faad514945b84d8_SeqId_47_) 2023-11-21 13:54:29,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__hd8u0h7eajieivb7srhd3bv1ha319gh2libbj634ft9ihl6amappq4ouj153jeem/family1/34059151d53441f483fc8fc17d7b0a66 2023-11-21 13:54:29,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-21 13:54:29,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-21 13:54:29,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(1912): e005e724571afdd7b19c1242ce731aca/family1 is initiating minor compaction (all files) 2023-11-21 13:54:29,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@414a5441; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:54:29,151 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e005e724571afdd7b19c1242ce731aca/family1 in testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:54:29,152 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/a59de11af83f44fa83783a31a1fa81a3, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/f51a74ac0dfe4210b240f49bbdf5b5aa, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/d05bb3dace2a49b79faad514945b84d8_SeqId_47_] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp, totalSize=337.0 K 2023-11-21 13:54:29,152 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting a59de11af83f44fa83783a31a1fa81a3, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878827509 2023-11-21 13:54:29,152 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting f51a74ac0dfe4210b240f49bbdf5b5aa, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621227509 2023-11-21 13:54:29,153 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting d05bb3dace2a49b79faad514945b84d8_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878827509 2023-11-21 13:54:29,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-21 13:54:29,155 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:29,157 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511301e2b95a4ce1a49f18beb02aa9887099e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511301e2b95a4ce1a49f18beb02aa9887099e 2023-11-21 13:54:29,158 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512019895657891574d208b3f45b85c8e6f6d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512019895657891574d208b3f45b85c8e6f6d 2023-11-21 13:54:29,159 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205ee14624839df48cb98b0724deb738e8d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205ee14624839df48cb98b0724deb738e8d 2023-11-21 13:54:29,159 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-21 13:54:29,159 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-21 13:54:29,160 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-21 13:54:29,160 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-21 13:54:29,160 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:54:29,160 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-21 13:54:29,162 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8200 sec 2023-11-21 13:54:29,169 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): e005e724571afdd7b19c1242ce731aca#family1#compaction#50 average throughput is 22.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-21 13:54:29,261 INFO [Listener at localhost/35077] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=248 (was 260), OpenFileDescriptor=623 (was 649), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=209 (was 247), ProcessCount=174 (was 174), AvailableMemoryMB=7005 (was 7042) 2023-11-21 13:54:29,272 INFO [Listener at localhost/35077] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=248, OpenFileDescriptor=623, MaxFileDescriptor=60000, SystemLoadAverage=209, ProcessCount=174, AvailableMemoryMB=7004 2023-11-21 13:54:29,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-21 13:54:29,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:29,276 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-21 13:54:29,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-21 13:54:29,277 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-21 13:54:29,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-21 13:54:29,278 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:29,279 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20 empty. 2023-11-21 13:54:29,279 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:29,279 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-21 13:54:29,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-21 13:54:29,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-21 13:54:29,687 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-21 13:54:29,688 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => fb33e3664562b9c0ab00fae49dcf8a20, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:54:29,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-21 13:54:30,094 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:54:30,094 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing fb33e3664562b9c0ab00fae49dcf8a20, disabling compactions & flushes 2023-11-21 13:54:30,094 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:30,094 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:30,094 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. after waiting 0 ms 2023-11-21 13:54:30,094 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:30,094 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:30,094 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:30,096 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-21 13:54:30,097 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700574870097"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574870097"}]},"ts":"1700574870097"} 2023-11-21 13:54:30,099 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-21 13:54:30,099 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-21 13:54:30,099 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574870099"}]},"ts":"1700574870099"} 2023-11-21 13:54:30,100 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-21 13:54:30,103 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fb33e3664562b9c0ab00fae49dcf8a20, ASSIGN}] 2023-11-21 13:54:30,105 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fb33e3664562b9c0ab00fae49dcf8a20, ASSIGN 2023-11-21 13:54:30,105 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fb33e3664562b9c0ab00fae49dcf8a20, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:54:30,256 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=fb33e3664562b9c0ab00fae49dcf8a20, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:30,256 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700574870256"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574870256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574870256"}]},"ts":"1700574870256"} 2023-11-21 13:54:30,258 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure fb33e3664562b9c0ab00fae49dcf8a20, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:54:30,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-21 13:54:30,387 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/.tmp/family1/9c79f863688d4fa7b934c84644cbef50 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/9c79f863688d4fa7b934c84644cbef50 2023-11-21 13:54:30,392 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e005e724571afdd7b19c1242ce731aca/family1 of e005e724571afdd7b19c1242ce731aca into 9c79f863688d4fa7b934c84644cbef50(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-21 13:54:30,392 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e005e724571afdd7b19c1242ce731aca: 2023-11-21 13:54:30,392 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1700574869151; duration=1sec 2023-11-21 13:54:30,392 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:54:30,402 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/a59de11af83f44fa83783a31a1fa81a3, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/f51a74ac0dfe4210b240f49bbdf5b5aa, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/d05bb3dace2a49b79faad514945b84d8_SeqId_47_] to archive 2023-11-21 13:54:30,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:30,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/a59de11af83f44fa83783a31a1fa81a3 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/a59de11af83f44fa83783a31a1fa81a3 2023-11-21 13:54:30,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/f51a74ac0dfe4210b240f49bbdf5b5aa to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/f51a74ac0dfe4210b240f49bbdf5b5aa 2023-11-21 13:54:30,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/d05bb3dace2a49b79faad514945b84d8_SeqId_47_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/family1/d05bb3dace2a49b79faad514945b84d8_SeqId_47_ 2023-11-21 13:54:30,409 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:30,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:30,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fb33e3664562b9c0ab00fae49dcf8a20, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.', STARTKEY => '', ENDKEY => ''} 2023-11-21 13:54:30,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:30,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:54:30,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:30,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:30,413 INFO [StoreOpener-fb33e3664562b9c0ab00fae49dcf8a20-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:30,414 DEBUG [StoreOpener-fb33e3664562b9c0ab00fae49dcf8a20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1 2023-11-21 13:54:30,414 DEBUG [StoreOpener-fb33e3664562b9c0ab00fae49dcf8a20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1 2023-11-21 13:54:30,415 INFO [StoreOpener-fb33e3664562b9c0ab00fae49dcf8a20-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb33e3664562b9c0ab00fae49dcf8a20 columnFamilyName family1 2023-11-21 13:54:30,416 INFO [StoreOpener-fb33e3664562b9c0ab00fae49dcf8a20-1] regionserver.HStore(310): Store=fb33e3664562b9c0ab00fae49dcf8a20/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:54:30,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:30,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:30,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:30,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:54:30,421 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened fb33e3664562b9c0ab00fae49dcf8a20; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66694726, jitterRate=-0.006171137094497681}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-21 13:54:30,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:30,421 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20., pid=41, masterSystemTime=1700574870409 2023-11-21 13:54:30,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:30,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:30,423 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=fb33e3664562b9c0ab00fae49dcf8a20, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:30,423 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700574870423"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574870423"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574870423"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574870423"}]},"ts":"1700574870423"} 2023-11-21 13:54:30,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=41, resume processing ppid=40 2023-11-21 13:54:30,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure fb33e3664562b9c0ab00fae49dcf8a20, server=jenkins-hbase6.apache.org,46365,1700574804408 in 166 msec 2023-11-21 13:54:30,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=40, resume processing ppid=39 2023-11-21 13:54:30,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fb33e3664562b9c0ab00fae49dcf8a20, ASSIGN in 323 msec 2023-11-21 13:54:30,428 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-21 13:54:30,428 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574870428"}]},"ts":"1700574870428"} 2023-11-21 13:54:30,429 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-21 13:54:30,433 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-21 13:54:30,433 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1590 sec 2023-11-21 13:54:31,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-21 13:54:31,382 INFO [Listener at localhost/35077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-21 13:54:31,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:31,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:31,407 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:31,407 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:31,407 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-21 13:54:31,407 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-21 13:54:31,407 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:31,407 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:31,409 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:31,409 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:31,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:31,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:31,409 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:31,409 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:31,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:31,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:31,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:31,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:31,410 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:31,410 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:31,410 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-21 13:54:31,410 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:31,410 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-21 13:54:31,410 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:31,411 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:31,411 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:31,411 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. started... 2023-11-21 13:54:31,411 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fb33e3664562b9c0ab00fae49dcf8a20 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-21 13:54:31,690 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:31,830 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a97a722023db4d8c97149ad420e7758e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130a97a722023db4d8c97149ad420e7758e 2023-11-21 13:54:32,234 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/2fc8bad0a619410c9e0012992af29b60 2023-11-21 13:54:32,239 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/2fc8bad0a619410c9e0012992af29b60 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/2fc8bad0a619410c9e0012992af29b60 2023-11-21 13:54:32,243 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/2fc8bad0a619410c9e0012992af29b60, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-21 13:54:32,244 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for fb33e3664562b9c0ab00fae49dcf8a20 in 833ms, sequenceid=5, compaction requested=false 2023-11-21 13:54:32,245 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:32,245 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:32,245 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:32,245 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:32,245 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:32,245 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-21 13:54:32,245 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-21 13:54:32,247 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:32,247 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:32,247 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,247 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:32,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:32,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:32,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-21 13:54:32,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aa330cb[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:32,249 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-21 13:54:32,249 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,251 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,251 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-21 13:54:32,251 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-21 13:54:32,251 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:32,251 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:32,251 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:32,252 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:32,252 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-21 13:54:32,252 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:32,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:32,252 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-21 13:54:32,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:32,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:32,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:32,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:32,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:32,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:32,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:32,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-21 13:54:32,255 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-21 13:54:32,255 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:32,255 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:32,255 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,255 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:32,257 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,257 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:32,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:32,257 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:32,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:32,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:32,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:32,258 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:32,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:32,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:32,259 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:32,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:32,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:32,261 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:32,262 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:32,262 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:32,262 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:32,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:32,262 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:32,262 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:32,262 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:32,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:32,262 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,262 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:32,262 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,262 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:32,262 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:32,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:32,362 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:32,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:32,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:32,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:32,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,368 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:32,368 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:32,368 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-21 13:54:32,368 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-21 13:54:32,369 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,369 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,371 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:32,371 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:32,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:32,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:32,371 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:32,371 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:32,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,372 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:32,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,372 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,372 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-21 13:54:32,372 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:32,372 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-21 13:54:32,372 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:32,372 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-21 13:54:32,373 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:32,373 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:32,373 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:32,373 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. started... 2023-11-21 13:54:32,373 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fb33e3664562b9c0ab00fae49dcf8a20 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-21 13:54:32,785 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112844a961cdd7ff45de91af7bb47c9bd319 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112844a961cdd7ff45de91af7bb47c9bd319 2023-11-21 13:54:33,191 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/f00cf5842a524a37a49d4c376607e13c 2023-11-21 13:54:33,197 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/f00cf5842a524a37a49d4c376607e13c as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/f00cf5842a524a37a49d4c376607e13c 2023-11-21 13:54:33,201 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/f00cf5842a524a37a49d4c376607e13c, entries=1, sequenceid=9, filesize=5.0 K 2023-11-21 13:54:33,202 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for fb33e3664562b9c0ab00fae49dcf8a20 in 829ms, sequenceid=9, compaction requested=false 2023-11-21 13:54:33,202 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:33,202 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:33,202 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:33,202 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:33,202 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:33,202 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-21 13:54:33,202 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-21 13:54:33,204 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,204 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:33,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:33,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:33,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:33,205 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,205 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:33,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:33,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:33,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:33,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:33,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-21 13:54:33,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48106784[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:33,206 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-21 13:54:33,206 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,208 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,208 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-21 13:54:33,208 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-21 13:54:33,208 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:33,208 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:33,208 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:33,209 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:33,209 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-21 13:54:33,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:33,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:33,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:33,209 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:33,209 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-21 13:54:33,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:33,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:33,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:33,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:33,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:33,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:33,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-21 13:54:33,212 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-21 13:54:33,212 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:33,212 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:33,212 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,212 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:33,215 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,215 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:33,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,215 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:33,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:33,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:33,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:33,216 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:33,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:33,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:33,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,217 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:33,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:33,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:33,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:33,221 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:33,221 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,222 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,222 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:33,222 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:33,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:33,222 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,222 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,222 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:33,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:33,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-21 13:54:33,222 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:33,222 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:33,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:33,222 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:33,222 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:33,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:33,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:33,322 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:33,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:33,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:33,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:33,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,328 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:33,328 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:33,328 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-21 13:54:33,328 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-21 13:54:33,329 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,329 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,331 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:33,331 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:33,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:33,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:33,331 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:33,331 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:33,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:33,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,332 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,332 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-21 13:54:33,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:33,332 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-21 13:54:33,332 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:33,332 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-21 13:54:33,332 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:33,332 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:33,332 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:33,332 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. started... 2023-11-21 13:54:33,332 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fb33e3664562b9c0ab00fae49dcf8a20 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:33,745 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201836b0e6ec60a4c8581b0503de70406ea to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201836b0e6ec60a4c8581b0503de70406ea 2023-11-21 13:54:34,151 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/50c5277fb0c94e53b0726d85e19a6911 2023-11-21 13:54:34,155 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/50c5277fb0c94e53b0726d85e19a6911 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/50c5277fb0c94e53b0726d85e19a6911 2023-11-21 13:54:34,159 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/50c5277fb0c94e53b0726d85e19a6911, entries=1, sequenceid=13, filesize=5.0 K 2023-11-21 13:54:34,160 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fb33e3664562b9c0ab00fae49dcf8a20 in 828ms, sequenceid=13, compaction requested=true 2023-11-21 13:54:34,160 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:34,160 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:34,160 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:34,160 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:34,160 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:34,160 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-21 13:54:34,160 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-21 13:54:34,163 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:34,163 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:34,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:34,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:34,163 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,163 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:34,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:34,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:34,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:34,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:34,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-21 13:54:34,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@372fae23[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:34,165 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-21 13:54:34,165 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,166 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,166 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-21 13:54:34,166 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-21 13:54:34,166 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:34,166 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:34,166 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:34,168 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:34,168 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-21 13:54:34,168 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:34,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:34,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:34,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:34,168 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-21 13:54:34,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:34,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:34,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:34,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:34,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:34,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:34,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-21 13:54:34,170 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-21 13:54:34,170 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:34,170 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:34,170 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,170 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:34,172 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,172 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,172 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:34,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:34,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:34,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:34,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:34,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:34,173 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:34,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:34,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:34,174 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:34,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:34,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:34,177 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:34,177 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,177 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:34,177 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,177 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:34,177 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:34,177 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:34,177 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:34,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:34,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:34,177 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:34,177 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,177 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:34,178 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:34,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:34,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:34,278 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:34,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:34,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:34,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:34,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,284 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:34,284 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:34,284 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-21 13:54:34,284 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-21 13:54:34,284 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,284 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,285 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:34,285 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:34,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:34,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:34,286 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:34,286 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:34,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:34,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,287 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,287 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-21 13:54:34,287 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:34,287 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-21 13:54:34,287 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:34,287 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-21 13:54:34,287 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:34,287 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:34,287 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:34,287 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. started... 2023-11-21 13:54:34,287 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fb33e3664562b9c0ab00fae49dcf8a20 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:34,714 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055aec62d843b04814b92ef90b9c755ab6 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512055aec62d843b04814b92ef90b9c755ab6 2023-11-21 13:54:35,119 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/58ef2fde90574ecd9ed1beb21be689d2 2023-11-21 13:54:35,124 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/58ef2fde90574ecd9ed1beb21be689d2 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/58ef2fde90574ecd9ed1beb21be689d2 2023-11-21 13:54:35,127 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/58ef2fde90574ecd9ed1beb21be689d2, entries=1, sequenceid=17, filesize=5.0 K 2023-11-21 13:54:35,128 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fb33e3664562b9c0ab00fae49dcf8a20 in 841ms, sequenceid=17, compaction requested=true 2023-11-21 13:54:35,128 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:35,128 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:35,128 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:35,128 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:35,128 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:35,129 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-21 13:54:35,129 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-21 13:54:35,130 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:35,130 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:35,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:35,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:35,131 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,131 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:35,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:35,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:35,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:35,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:35,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-21 13:54:35,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2fd8576a[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:35,132 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-21 13:54:35,132 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,133 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,134 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-21 13:54:35,134 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-21 13:54:35,134 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:35,134 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:35,134 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:35,136 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:35,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:35,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:35,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:35,136 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-21 13:54:35,137 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:35,137 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-21 13:54:35,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:35,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:35,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:35,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:35,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:35,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:35,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-21 13:54:35,139 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-21 13:54:35,139 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:35,139 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:35,139 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,139 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:35,141 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,141 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:35,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:35,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,141 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:35,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:35,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:35,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:35,142 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:35,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:35,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:35,144 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:35,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:35,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:35,146 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:35,146 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:35,146 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:35,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:35,146 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,146 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:35,146 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,146 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,146 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:35,146 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:35,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:35,147 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:35,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:35,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:35,147 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:35,147 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:35,247 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:35,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:35,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:35,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:35,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,253 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:35,253 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:35,253 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-21 13:54:35,253 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-21 13:54:35,253 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,253 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,258 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:35,258 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:35,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:35,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:35,259 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:35,259 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:35,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:35,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,260 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,260 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-21 13:54:35,260 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:35,260 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-21 13:54:35,260 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:35,260 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-21 13:54:35,260 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:35,260 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:35,260 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:35,260 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. started... 2023-11-21 13:54:35,260 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fb33e3664562b9c0ab00fae49dcf8a20 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:35,672 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228614be6d6d1534ef8af33d047273224d3 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228614be6d6d1534ef8af33d047273224d3 2023-11-21 13:54:35,945 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-21 13:54:36,077 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/49500a01740f40c592b546f979c83c85 2023-11-21 13:54:36,082 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/49500a01740f40c592b546f979c83c85 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/49500a01740f40c592b546f979c83c85 2023-11-21 13:54:36,085 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/49500a01740f40c592b546f979c83c85, entries=1, sequenceid=21, filesize=5.0 K 2023-11-21 13:54:36,086 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fb33e3664562b9c0ab00fae49dcf8a20 in 826ms, sequenceid=21, compaction requested=true 2023-11-21 13:54:36,086 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:36,086 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:36,086 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:36,086 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:36,086 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:36,086 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-21 13:54:36,086 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-21 13:54:36,088 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:36,088 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:36,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:36,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:36,089 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,089 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:36,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:36,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:36,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:36,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:36,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-21 13:54:36,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cce1f32[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:36,090 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-21 13:54:36,090 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,091 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,091 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-21 13:54:36,091 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-21 13:54:36,091 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:36,091 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:36,091 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:36,093 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:36,093 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-21 13:54:36,093 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:36,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:36,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:36,093 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-21 13:54:36,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:36,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:36,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:36,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:36,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:36,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:36,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:36,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-21 13:54:36,095 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-21 13:54:36,095 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:36,095 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:36,095 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,095 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:36,097 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,097 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:36,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:36,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,097 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:36,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:36,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:36,098 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:36,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:36,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:36,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:36,099 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:36,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:36,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:36,102 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:36,102 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,102 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,102 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:36,102 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:36,102 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:36,102 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:36,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-21 13:54:36,102 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,102 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:36,102 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:36,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:36,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:36,102 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:36,103 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:36,203 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:36,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:36,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:36,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:36,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,208 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:36,209 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:36,209 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-21 13:54:36,209 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-21 13:54:36,209 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,209 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,211 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:36,211 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:36,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:36,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:36,211 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:36,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,211 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:36,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:36,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,212 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,212 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-21 13:54:36,212 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:36,212 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-21 13:54:36,212 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:36,212 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-21 13:54:36,212 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:36,212 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:36,212 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:36,212 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. started... 2023-11-21 13:54:36,212 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fb33e3664562b9c0ab00fae49dcf8a20 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:36,625 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231dfa761f7701d42dead88c93642e6a147 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231dfa761f7701d42dead88c93642e6a147 2023-11-21 13:54:37,031 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/4a1041a73f1e49a8862bd8c8be2781d3 2023-11-21 13:54:37,035 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/4a1041a73f1e49a8862bd8c8be2781d3 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/4a1041a73f1e49a8862bd8c8be2781d3 2023-11-21 13:54:37,039 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/4a1041a73f1e49a8862bd8c8be2781d3, entries=1, sequenceid=25, filesize=5.0 K 2023-11-21 13:54:37,040 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fb33e3664562b9c0ab00fae49dcf8a20 in 828ms, sequenceid=25, compaction requested=true 2023-11-21 13:54:37,040 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:37,040 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:37,040 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:37,040 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:37,040 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,040 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-21 13:54:37,040 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-21 13:54:37,042 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,042 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:37,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:37,042 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,042 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:37,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:37,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-21 13:54:37,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57a97768[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:37,044 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-21 13:54:37,044 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,045 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,045 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-21 13:54:37,045 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-21 13:54:37,045 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:37,045 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,045 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:37,046 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-21 13:54:37,046 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:37,046 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,046 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-21 13:54:37,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:37,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:37,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:37,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:37,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:37,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-21 13:54:37,049 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-21 13:54:37,049 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:37,049 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:37,049 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,049 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:37,051 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,051 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,051 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:37,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:37,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:37,052 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:37,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,053 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:37,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,056 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,056 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:37,056 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,056 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:37,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:37,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:37,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:37,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:37,056 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:37,056 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,056 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,056 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,056 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,056 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,056 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:37,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:37,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:37,056 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:37,156 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:37,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:37,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:37,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:37,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,162 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:37,162 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:37,162 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-21 13:54:37,162 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-21 13:54:37,163 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,163 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,164 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:37,164 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:37,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:37,165 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,165 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:37,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:37,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,165 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,165 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-21 13:54:37,165 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,166 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-21 13:54:37,166 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:37,166 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-21 13:54:37,166 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:37,166 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:37,166 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:37,166 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. started... 2023-11-21 13:54:37,166 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fb33e3664562b9c0ab00fae49dcf8a20 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:37,577 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101975435b35d3c44e0835bc3f907225e2e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101975435b35d3c44e0835bc3f907225e2e 2023-11-21 13:54:37,983 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/836b8bcec6b147d4a43a5c33831aa4b3 2023-11-21 13:54:37,988 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/836b8bcec6b147d4a43a5c33831aa4b3 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/836b8bcec6b147d4a43a5c33831aa4b3 2023-11-21 13:54:37,991 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/836b8bcec6b147d4a43a5c33831aa4b3, entries=1, sequenceid=29, filesize=5.0 K 2023-11-21 13:54:37,992 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fb33e3664562b9c0ab00fae49dcf8a20 in 826ms, sequenceid=29, compaction requested=true 2023-11-21 13:54:37,992 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:37,992 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:37,992 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:37,992 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:37,992 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,992 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-21 13:54:37,992 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-21 13:54:37,994 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,994 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:37,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:37,994 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,995 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:37,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:37,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:37,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:37,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-21 13:54:37,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dbd9508[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:37,996 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-21 13:54:37,996 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,998 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:37,998 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-21 13:54:37,999 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-21 13:54:37,999 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:37,999 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:37,999 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:38,002 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-21 13:54:38,002 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:38,002 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-21 13:54:38,002 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:38,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:38,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:38,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:38,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:38,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:38,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-21 13:54:38,006 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-21 13:54:38,006 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:38,006 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:38,006 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,006 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:38,007 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,007 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,007 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:38,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:38,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:38,008 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:38,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,009 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:38,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,013 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,013 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,013 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:38,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:38,013 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:38,013 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:38,013 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,013 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,013 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,013 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,013 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,013 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-21 13:54:38,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:38,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:38,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:38,014 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:38,014 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:38,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:38,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:38,114 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:38,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:38,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:38,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:38,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,121 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:38,121 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:38,121 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-21 13:54:38,121 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-21 13:54:38,122 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,122 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,123 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,123 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:38,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:38,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:38,124 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,124 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:38,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:38,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,125 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,125 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-21 13:54:38,125 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,125 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-21 13:54:38,125 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:38,125 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-21 13:54:38,125 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:38,125 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:38,125 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:38,125 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. started... 2023-11-21 13:54:38,125 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fb33e3664562b9c0ab00fae49dcf8a20 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:38,537 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e5cebbe032554b4299bc1e4026c92ada to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103e5cebbe032554b4299bc1e4026c92ada 2023-11-21 13:54:38,943 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/3bb73996343d450dbbaab1215554d099 2023-11-21 13:54:38,947 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/3bb73996343d450dbbaab1215554d099 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/3bb73996343d450dbbaab1215554d099 2023-11-21 13:54:38,951 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/3bb73996343d450dbbaab1215554d099, entries=1, sequenceid=33, filesize=5.0 K 2023-11-21 13:54:38,952 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fb33e3664562b9c0ab00fae49dcf8a20 in 827ms, sequenceid=33, compaction requested=true 2023-11-21 13:54:38,952 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:38,952 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:38,952 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:38,952 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:38,952 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,952 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-21 13:54:38,952 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-21 13:54:38,954 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,954 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:38,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:38,954 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,954 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:38,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:38,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:38,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:38,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-21 13:54:38,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7033f2d2[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:38,955 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-21 13:54:38,955 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,957 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,957 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-21 13:54:38,957 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-21 13:54:38,957 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:38,957 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,957 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:38,961 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-21 13:54:38,962 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,962 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:38,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:38,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:38,962 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-21 13:54:38,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:38,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:38,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:38,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:38,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-21 13:54:38,964 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-21 13:54:38,964 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:38,964 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:38,964 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,964 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:38,966 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,966 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:38,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:38,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,966 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:38,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:38,966 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:38,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:38,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:38,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,967 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:38,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,970 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,970 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:38,970 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:38,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:38,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:38,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:38,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-21 13:54:38,970 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:38,970 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,970 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:38,970 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:38,971 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:38,970 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:38,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:38,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:38,971 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,971 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:38,971 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,071 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:39,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:39,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:39,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:39,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,077 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:39,077 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:39,077 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-21 13:54:39,077 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-21 13:54:39,078 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,078 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,079 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,079 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:39,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:39,079 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,079 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,080 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,080 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-21 13:54:39,080 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,080 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-21 13:54:39,081 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:39,081 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-21 13:54:39,081 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:39,081 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:39,081 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:39,081 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. started... 2023-11-21 13:54:39,081 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fb33e3664562b9c0ab00fae49dcf8a20 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:39,091 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907859b75627d5b4394a88434c22d495b61 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907859b75627d5b4394a88434c22d495b61 2023-11-21 13:54:39,496 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/6a3de8a6bc7d468e827e878431f8a4cc 2023-11-21 13:54:39,501 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/6a3de8a6bc7d468e827e878431f8a4cc as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/6a3de8a6bc7d468e827e878431f8a4cc 2023-11-21 13:54:39,504 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/6a3de8a6bc7d468e827e878431f8a4cc, entries=1, sequenceid=37, filesize=5.0 K 2023-11-21 13:54:39,505 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fb33e3664562b9c0ab00fae49dcf8a20 in 424ms, sequenceid=37, compaction requested=true 2023-11-21 13:54:39,505 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:39,505 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:39,505 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:39,505 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:39,505 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,505 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-21 13:54:39,505 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-21 13:54:39,508 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,508 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:39,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:39,508 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,508 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:39,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:39,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:39,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:39,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-21 13:54:39,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c685469[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:39,510 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-21 13:54:39,510 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,511 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,511 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-21 13:54:39,511 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-21 13:54:39,511 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:39,511 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,511 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:39,512 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-21 13:54:39,512 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:39,512 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,512 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-21 13:54:39,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:39,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:39,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:39,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:39,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:39,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:39,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-21 13:54:39,515 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-21 13:54:39,515 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:39,515 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:39,515 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,515 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:39,516 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,516 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:39,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:39,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,516 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:39,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:39,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:39,517 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:39,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:39,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,518 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:39,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,523 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,523 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:39,523 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:39,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:39,523 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:39,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:39,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:39,524 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:39,524 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,524 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,524 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:39,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:39,524 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,524 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:39,524 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:39,524 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,624 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:39,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:39,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:39,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:39,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,630 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:39,630 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:39,630 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-21 13:54:39,630 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-21 13:54:39,631 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,631 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,632 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:39,632 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:39,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:39,632 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:39,632 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,633 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:39,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,633 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,634 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-21 13:54:39,634 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:39,634 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-21 13:54:39,634 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:39,634 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-21 13:54:39,634 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:39,634 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:39,634 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:39,634 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. started... 2023-11-21 13:54:39,634 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fb33e3664562b9c0ab00fae49dcf8a20 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:40,049 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120a2f790a1a6de47fb98f4f05780f935f5 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120a2f790a1a6de47fb98f4f05780f935f5 2023-11-21 13:54:40,454 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/031f2d79a332484c8429d96e41b71602 2023-11-21 13:54:40,459 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/031f2d79a332484c8429d96e41b71602 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/031f2d79a332484c8429d96e41b71602 2023-11-21 13:54:40,463 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/031f2d79a332484c8429d96e41b71602, entries=1, sequenceid=41, filesize=5.0 K 2023-11-21 13:54:40,463 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fb33e3664562b9c0ab00fae49dcf8a20 in 829ms, sequenceid=41, compaction requested=true 2023-11-21 13:54:40,464 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:40,464 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:40,464 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:40,464 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:40,464 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:40,464 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-21 13:54:40,464 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-21 13:54:40,465 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:40,465 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:40,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:40,466 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,466 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:40,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-21 13:54:40,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6662bb[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:40,467 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-21 13:54:40,467 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,469 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,469 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-21 13:54:40,469 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-21 13:54:40,469 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:40,469 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:40,469 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:40,471 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-21 13:54:40,471 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:40,471 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:40,471 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-21 13:54:40,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:40,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:40,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:40,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:40,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:40,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:40,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:40,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:40,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:40,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-21 13:54:40,474 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-21 13:54:40,474 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:40,474 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:40,474 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,474 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:40,476 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,476 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:40,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,476 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:40,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:40,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:40,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:40,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:40,477 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:40,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:40,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:40,478 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:40,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:40,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:40,481 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:40,481 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,481 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,481 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:40,481 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-21 13:54:40,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:40,481 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:40,481 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:40,481 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:40,481 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,481 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:40,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:40,481 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:40,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:40,482 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:40,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:40,582 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:40,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:40,584 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43219] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:40,585 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-21 13:54:40,586 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-21 13:54:40,587 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:54:40,587 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700575480587 2023-11-21 13:54:40,590 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-21 13:54:40,591 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-21 13:54:40,591 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-21 13:54:40,592 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] zookeeper.ReadOnlyZKClient(139): Connect 0x27c74d9c to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:54:40,596 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d7293fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:54:40,596 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:41,432 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037d6b90cfff67443bbe4e0bc6b4d895fc to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601037d6b90cfff67443bbe4e0bc6b4d895fc 2023-11-21 13:54:41,433 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-21 13:54:41,446 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:54:41,447 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:33106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:54:41,453 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-21 13:54:41,454 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:33522, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-21 13:54:41,462 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/885f2053152b43998c15317796923b12 first=Optional[r3] last=Optional[r6] 2023-11-21 13:54:41,463 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/885f2053152b43998c15317796923b12}] 2023-11-21 13:54:41,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/885f2053152b43998c15317796923b12 for inclusion in fb33e3664562b9c0ab00fae49dcf8a20/family1 2023-11-21 13:54:41,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-21 13:54:41,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:54:41,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:41,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/885f2053152b43998c15317796923b12 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__oiuclmqb03aff6sg1tl505vavqf6r145fjhhjekktnpsb6ma6o83n66i4igsn86a/family1/885f2053152b43998c15317796923b12 2023-11-21 13:54:41,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__oiuclmqb03aff6sg1tl505vavqf6r145fjhhjekktnpsb6ma6o83n66i4igsn86a/family1/885f2053152b43998c15317796923b12 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/3a7059b84d17482da59120c42e79eb37_SeqId_44_ 2023-11-21 13:54:41,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__oiuclmqb03aff6sg1tl505vavqf6r145fjhhjekktnpsb6ma6o83n66i4igsn86a/family1/885f2053152b43998c15317796923b12 into fb33e3664562b9c0ab00fae49dcf8a20/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/3a7059b84d17482da59120c42e79eb37_SeqId_44_ - updating store file list. 2023-11-21 13:54:41,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/3a7059b84d17482da59120c42e79eb37_SeqId_44_ into fb33e3664562b9c0ab00fae49dcf8a20/family1 2023-11-21 13:54:41,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__oiuclmqb03aff6sg1tl505vavqf6r145fjhhjekktnpsb6ma6o83n66i4igsn86a/family1/885f2053152b43998c15317796923b12 into fb33e3664562b9c0ab00fae49dcf8a20/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/3a7059b84d17482da59120c42e79eb37_SeqId_44_) 2023-11-21 13:54:41,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__oiuclmqb03aff6sg1tl505vavqf6r145fjhhjekktnpsb6ma6o83n66i4igsn86a/family1/885f2053152b43998c15317796923b12 2023-11-21 13:54:41,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-21 13:54:41,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-21 13:54:41,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(1912): fb33e3664562b9c0ab00fae49dcf8a20/family1 is initiating minor compaction 2023-11-21 13:54:41,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@47e24db2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:54:41,480 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fb33e3664562b9c0ab00fae49dcf8a20/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:41,480 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/f00cf5842a524a37a49d4c376607e13c, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/50c5277fb0c94e53b0726d85e19a6911, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/58ef2fde90574ecd9ed1beb21be689d2, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/49500a01740f40c592b546f979c83c85, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/4a1041a73f1e49a8862bd8c8be2781d3, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/836b8bcec6b147d4a43a5c33831aa4b3, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/3bb73996343d450dbbaab1215554d099, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/6a3de8a6bc7d468e827e878431f8a4cc, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/031f2d79a332484c8429d96e41b71602, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/3a7059b84d17482da59120c42e79eb37_SeqId_44_] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp, totalSize=50.4 K 2023-11-21 13:54:41,480 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting f00cf5842a524a37a49d4c376607e13c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-21 13:54:41,480 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 50c5277fb0c94e53b0726d85e19a6911, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-21 13:54:41,480 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 58ef2fde90574ecd9ed1beb21be689d2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-21 13:54:41,480 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 49500a01740f40c592b546f979c83c85, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-21 13:54:41,480 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 4a1041a73f1e49a8862bd8c8be2781d3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-21 13:54:41,480 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 836b8bcec6b147d4a43a5c33831aa4b3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-21 13:54:41,480 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 3bb73996343d450dbbaab1215554d099, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-21 13:54:41,480 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 6a3de8a6bc7d468e827e878431f8a4cc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-21 13:54:41,480 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 031f2d79a332484c8429d96e41b71602, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-21 13:54:41,480 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 3a7059b84d17482da59120c42e79eb37_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-21 13:54:41,481 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-21 13:54:41,482 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:41,484 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228614be6d6d1534ef8af33d047273224d3 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228614be6d6d1534ef8af33d047273224d3 2023-11-21 13:54:41,485 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231dfa761f7701d42dead88c93642e6a147 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231dfa761f7701d42dead88c93642e6a147 2023-11-21 13:54:41,486 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101975435b35d3c44e0835bc3f907225e2e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101975435b35d3c44e0835bc3f907225e2e 2023-11-21 13:54:41,487 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103e5cebbe032554b4299bc1e4026c92ada to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103e5cebbe032554b4299bc1e4026c92ada 2023-11-21 13:54:41,487 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-21 13:54:41,488 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-21 13:54:41,488 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:41,488 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:41,488 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:41,488 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:41,488 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:41,488 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:41,488 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:41,488 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:41,519 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): fb33e3664562b9c0ab00fae49dcf8a20#family1#compaction#61 average throughput is 0.14 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-21 13:54:41,947 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/43747472be11460fa7e939941824f6a9 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/43747472be11460fa7e939941824f6a9 2023-11-21 13:54:41,947 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fadecf2053f9435fa2ffe5d7853bdda6 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205fadecf2053f9435fa2ffe5d7853bdda6 2023-11-21 13:54:41,948 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-21 13:54:41,952 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in fb33e3664562b9c0ab00fae49dcf8a20/family1 of fb33e3664562b9c0ab00fae49dcf8a20 into 43747472be11460fa7e939941824f6a9(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:54:41,952 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:41,952 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1700574881480; duration=0sec 2023-11-21 13:54:41,952 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:54:41,971 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ad329ba5e4ff4df8b7b1a8aade6ba3f6 first=Optional[r00] last=Optional[r2] 2023-11-21 13:54:41,971 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ad329ba5e4ff4df8b7b1a8aade6ba3f6}] 2023-11-21 13:54:41,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ad329ba5e4ff4df8b7b1a8aade6ba3f6 for inclusion in fb33e3664562b9c0ab00fae49dcf8a20/family1 2023-11-21 13:54:41,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-21 13:54:41,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:54:41,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:41,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ad329ba5e4ff4df8b7b1a8aade6ba3f6 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__thjbqegstommlqrm3vr8qffssrkbj224ntg0ras13juf02ogk305sh35gkabr2t9/family1/ad329ba5e4ff4df8b7b1a8aade6ba3f6 2023-11-21 13:54:41,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__thjbqegstommlqrm3vr8qffssrkbj224ntg0ras13juf02ogk305sh35gkabr2t9/family1/ad329ba5e4ff4df8b7b1a8aade6ba3f6 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/4c4fe013e2c74f8dbe4f9267f6818d20_SeqId_47_ 2023-11-21 13:54:41,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__thjbqegstommlqrm3vr8qffssrkbj224ntg0ras13juf02ogk305sh35gkabr2t9/family1/ad329ba5e4ff4df8b7b1a8aade6ba3f6 into fb33e3664562b9c0ab00fae49dcf8a20/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/4c4fe013e2c74f8dbe4f9267f6818d20_SeqId_47_ - updating store file list. 2023-11-21 13:54:41,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/4c4fe013e2c74f8dbe4f9267f6818d20_SeqId_47_ into fb33e3664562b9c0ab00fae49dcf8a20/family1 2023-11-21 13:54:41,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__thjbqegstommlqrm3vr8qffssrkbj224ntg0ras13juf02ogk305sh35gkabr2t9/family1/ad329ba5e4ff4df8b7b1a8aade6ba3f6 into fb33e3664562b9c0ab00fae49dcf8a20/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/4c4fe013e2c74f8dbe4f9267f6818d20_SeqId_47_) 2023-11-21 13:54:41,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__thjbqegstommlqrm3vr8qffssrkbj224ntg0ras13juf02ogk305sh35gkabr2t9/family1/ad329ba5e4ff4df8b7b1a8aade6ba3f6 2023-11-21 13:54:41,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-21 13:54:41,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-21 13:54:41,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(1912): fb33e3664562b9c0ab00fae49dcf8a20/family1 is initiating minor compaction (all files) 2023-11-21 13:54:41,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2ec033e0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:54:41,983 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fb33e3664562b9c0ab00fae49dcf8a20/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:41,983 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/2fc8bad0a619410c9e0012992af29b60, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/43747472be11460fa7e939941824f6a9, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/4c4fe013e2c74f8dbe4f9267f6818d20_SeqId_47_] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp, totalSize=390.1 K 2023-11-21 13:54:41,984 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 2fc8bad0a619410c9e0012992af29b60, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878827509 2023-11-21 13:54:41,984 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 43747472be11460fa7e939941824f6a9, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621227509 2023-11-21 13:54:41,985 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 4c4fe013e2c74f8dbe4f9267f6818d20_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878827509 2023-11-21 13:54:41,985 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-21 13:54:41,985 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:41,987 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130a97a722023db4d8c97149ad420e7758e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130a97a722023db4d8c97149ad420e7758e 2023-11-21 13:54:41,988 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201836b0e6ec60a4c8581b0503de70406ea to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201836b0e6ec60a4c8581b0503de70406ea 2023-11-21 13:54:41,989 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512055aec62d843b04814b92ef90b9c755ab6 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512055aec62d843b04814b92ef90b9c755ab6 2023-11-21 13:54:41,989 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-21 13:54:41,989 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-21 13:54:41,989 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:41,989 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-21 13:54:41,989 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:54:41,990 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-21 13:54:41,992 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.4050 sec 2023-11-21 13:54:42,004 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/f00cf5842a524a37a49d4c376607e13c, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/50c5277fb0c94e53b0726d85e19a6911, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/58ef2fde90574ecd9ed1beb21be689d2, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/49500a01740f40c592b546f979c83c85, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/4a1041a73f1e49a8862bd8c8be2781d3, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/836b8bcec6b147d4a43a5c33831aa4b3, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/3bb73996343d450dbbaab1215554d099, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/6a3de8a6bc7d468e827e878431f8a4cc, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/031f2d79a332484c8429d96e41b71602, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/3a7059b84d17482da59120c42e79eb37_SeqId_44_] to archive 2023-11-21 13:54:42,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:42,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/f00cf5842a524a37a49d4c376607e13c to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/f00cf5842a524a37a49d4c376607e13c 2023-11-21 13:54:42,008 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): fb33e3664562b9c0ab00fae49dcf8a20#family1#compaction#62 average throughput is 12.90 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-21 13:54:42,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/50c5277fb0c94e53b0726d85e19a6911 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/50c5277fb0c94e53b0726d85e19a6911 2023-11-21 13:54:42,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/58ef2fde90574ecd9ed1beb21be689d2 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/58ef2fde90574ecd9ed1beb21be689d2 2023-11-21 13:54:42,012 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/49500a01740f40c592b546f979c83c85 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/49500a01740f40c592b546f979c83c85 2023-11-21 13:54:42,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/4a1041a73f1e49a8862bd8c8be2781d3 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/4a1041a73f1e49a8862bd8c8be2781d3 2023-11-21 13:54:42,015 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/836b8bcec6b147d4a43a5c33831aa4b3 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/836b8bcec6b147d4a43a5c33831aa4b3 2023-11-21 13:54:42,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/3bb73996343d450dbbaab1215554d099 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/3bb73996343d450dbbaab1215554d099 2023-11-21 13:54:42,018 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/6a3de8a6bc7d468e827e878431f8a4cc to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/6a3de8a6bc7d468e827e878431f8a4cc 2023-11-21 13:54:42,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/031f2d79a332484c8429d96e41b71602 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/031f2d79a332484c8429d96e41b71602 2023-11-21 13:54:42,022 DEBUG [hfile_cleaner-dir-scan-pool-1] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 17 more 2023-11-21 13:54:42,022 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/3a7059b84d17482da59120c42e79eb37_SeqId_44_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/3a7059b84d17482da59120c42e79eb37_SeqId_44_ 2023-11-21 13:54:42,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$12(2454): Client=jenkins//172.31.2.20 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-21 13:54:42,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:42,470 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-21 13:54:42,471 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-21 13:54:42,471 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-21 13:54:42,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-21 13:54:42,475 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fb33e3664562b9c0ab00fae49dcf8a20, REOPEN/MOVE}] 2023-11-21 13:54:42,475 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fb33e3664562b9c0ab00fae49dcf8a20, REOPEN/MOVE 2023-11-21 13:54:42,476 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=fb33e3664562b9c0ab00fae49dcf8a20, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:42,476 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700574882476"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574882476"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574882476"}]},"ts":"1700574882476"} 2023-11-21 13:54:42,478 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure fb33e3664562b9c0ab00fae49dcf8a20, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:54:42,629 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:42,629 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:42,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing fb33e3664562b9c0ab00fae49dcf8a20, disabling compactions & flushes 2023-11-21 13:54:42,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:43,227 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/.tmp/family1/d664ef04abb24ec1a507935ac988ff1f as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/d664ef04abb24ec1a507935ac988ff1f 2023-11-21 13:54:43,232 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in fb33e3664562b9c0ab00fae49dcf8a20/family1 of fb33e3664562b9c0ab00fae49dcf8a20 into d664ef04abb24ec1a507935ac988ff1f(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-21 13:54:43,232 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:43,232 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:43,232 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1700574881983; duration=1sec 2023-11-21 13:54:43,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:43,232 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:54:43,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. after waiting 0 ms 2023-11-21 13:54:43,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:43,232 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/2fc8bad0a619410c9e0012992af29b60, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/43747472be11460fa7e939941824f6a9, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/4c4fe013e2c74f8dbe4f9267f6818d20_SeqId_47_] to archive 2023-11-21 13:54:43,233 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:43,235 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/2fc8bad0a619410c9e0012992af29b60 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/2fc8bad0a619410c9e0012992af29b60 2023-11-21 13:54:43,236 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/43747472be11460fa7e939941824f6a9 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/43747472be11460fa7e939941824f6a9 2023-11-21 13:54:43,237 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/4c4fe013e2c74f8dbe4f9267f6818d20_SeqId_47_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/4c4fe013e2c74f8dbe4f9267f6818d20_SeqId_47_ 2023-11-21 13:54:43,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-21 13:54:43,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:43,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:43,242 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(3510): Not adding moved region record: fb33e3664562b9c0ab00fae49dcf8a20 to self. 2023-11-21 13:54:43,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:43,244 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=fb33e3664562b9c0ab00fae49dcf8a20, regionState=CLOSED 2023-11-21 13:54:43,244 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700574883244"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574883244"}]},"ts":"1700574883244"} 2023-11-21 13:54:43,246 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=46, resume processing ppid=45 2023-11-21 13:54:43,247 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure fb33e3664562b9c0ab00fae49dcf8a20, server=jenkins-hbase6.apache.org,46365,1700574804408 in 767 msec 2023-11-21 13:54:43,247 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fb33e3664562b9c0ab00fae49dcf8a20, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=true 2023-11-21 13:54:43,397 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=fb33e3664562b9c0ab00fae49dcf8a20, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:43,398 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700574883397"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574883397"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574883397"}]},"ts":"1700574883397"} 2023-11-21 13:54:43,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure fb33e3664562b9c0ab00fae49dcf8a20, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:54:43,551 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:43,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:43,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fb33e3664562b9c0ab00fae49dcf8a20, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.', STARTKEY => '', ENDKEY => ''} 2023-11-21 13:54:43,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:43,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:54:43,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:43,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:43,555 INFO [StoreOpener-fb33e3664562b9c0ab00fae49dcf8a20-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:43,556 DEBUG [StoreOpener-fb33e3664562b9c0ab00fae49dcf8a20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1 2023-11-21 13:54:43,556 DEBUG [StoreOpener-fb33e3664562b9c0ab00fae49dcf8a20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1 2023-11-21 13:54:43,556 INFO [StoreOpener-fb33e3664562b9c0ab00fae49dcf8a20-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb33e3664562b9c0ab00fae49dcf8a20 columnFamilyName family1 2023-11-21 13:54:43,561 DEBUG [StoreOpener-fb33e3664562b9c0ab00fae49dcf8a20-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/d664ef04abb24ec1a507935ac988ff1f 2023-11-21 13:54:43,561 INFO [StoreOpener-fb33e3664562b9c0ab00fae49dcf8a20-1] regionserver.HStore(310): Store=fb33e3664562b9c0ab00fae49dcf8a20/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:54:43,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:43,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:43,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:43,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened fb33e3664562b9c0ab00fae49dcf8a20; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59979992, jitterRate=-0.10622847080230713}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-21 13:54:43,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:43,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20., pid=47, masterSystemTime=1700574883551 2023-11-21 13:54:43,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:43,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:43,569 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=fb33e3664562b9c0ab00fae49dcf8a20, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:43,569 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700574883569"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574883569"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574883569"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574883569"}]},"ts":"1700574883569"} 2023-11-21 13:54:43,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=47, resume processing ppid=45 2023-11-21 13:54:43,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure fb33e3664562b9c0ab00fae49dcf8a20, server=jenkins-hbase6.apache.org,46365,1700574804408 in 171 msec 2023-11-21 13:54:43,573 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=45, resume processing ppid=44 2023-11-21 13:54:43,573 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fb33e3664562b9c0ab00fae49dcf8a20, REOPEN/MOVE in 1.0970 sec 2023-11-21 13:54:43,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=44, resume processing ppid=43 2023-11-21 13:54:43,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1020 sec 2023-11-21 13:54:43,577 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5150 sec 2023-11-21 13:54:43,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-21 13:54:43,579 INFO [Listener at localhost/35077] compactions.TestMobCompactor(278): alter status finished 2023-11-21 13:54:43,580 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43219] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:43,581 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-21 13:54:43,581 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-21 13:54:43,582 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:54:43,582 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700575483582 2023-11-21 13:54:43,583 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-21 13:54:43,583 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-21 13:54:43,583 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-21 13:54:43,585 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] zookeeper.ReadOnlyZKClient(139): Connect 0x51c56dcc to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:54:43,589 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18e1e969, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:54:43,589 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:43,589 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:43,589 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:43,589 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:43,589 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:44,415 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128dad97207f064495e872d6f69f0a4400d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128dad97207f064495e872d6f69f0a4400d 2023-11-21 13:54:44,416 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-21 13:54:44,431 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:54:44,432 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:33108, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:54:44,438 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-21 13:54:44,439 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:33532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-21 13:54:44,448 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2ae9fac39d8d47fbbb40b74eb35b234d first=Optional[r05] last=Optional[r8] 2023-11-21 13:54:44,449 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=51 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2ae9fac39d8d47fbbb40b74eb35b234d}] 2023-11-21 13:54:44,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2ae9fac39d8d47fbbb40b74eb35b234d for inclusion in fb33e3664562b9c0ab00fae49dcf8a20/family1 2023-11-21 13:54:44,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-21 13:54:44,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:54:44,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:44,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2ae9fac39d8d47fbbb40b74eb35b234d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hb73k4fprslkp6mef9t1cd81g2ci9bah7b2t77pqf0e6o8a66sp7627sh3smc365/family1/2ae9fac39d8d47fbbb40b74eb35b234d 2023-11-21 13:54:44,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hb73k4fprslkp6mef9t1cd81g2ci9bah7b2t77pqf0e6o8a66sp7627sh3smc365/family1/2ae9fac39d8d47fbbb40b74eb35b234d as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/1545062fab274b3aa292a3840834369b_SeqId_53_ 2023-11-21 13:54:44,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hb73k4fprslkp6mef9t1cd81g2ci9bah7b2t77pqf0e6o8a66sp7627sh3smc365/family1/2ae9fac39d8d47fbbb40b74eb35b234d into fb33e3664562b9c0ab00fae49dcf8a20/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/1545062fab274b3aa292a3840834369b_SeqId_53_ - updating store file list. 2023-11-21 13:54:44,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/1545062fab274b3aa292a3840834369b_SeqId_53_ into fb33e3664562b9c0ab00fae49dcf8a20/family1 2023-11-21 13:54:44,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hb73k4fprslkp6mef9t1cd81g2ci9bah7b2t77pqf0e6o8a66sp7627sh3smc365/family1/2ae9fac39d8d47fbbb40b74eb35b234d into fb33e3664562b9c0ab00fae49dcf8a20/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/1545062fab274b3aa292a3840834369b_SeqId_53_) 2023-11-21 13:54:44,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hb73k4fprslkp6mef9t1cd81g2ci9bah7b2t77pqf0e6o8a66sp7627sh3smc365/family1/2ae9fac39d8d47fbbb40b74eb35b234d 2023-11-21 13:54:44,467 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-21 13:54:44,467 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:44,469 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120a2f790a1a6de47fb98f4f05780f935f5 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120a2f790a1a6de47fb98f4f05780f935f5 2023-11-21 13:54:44,470 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112844a961cdd7ff45de91af7bb47c9bd319 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112844a961cdd7ff45de91af7bb47c9bd319 2023-11-21 13:54:44,470 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-21 13:54:44,470 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-21 13:54:44,470 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:44,471 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:44,471 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:44,471 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-21 13:54:44,471 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:54:44,472 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-21 13:54:44,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 892 msec 2023-11-21 13:54:44,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$12(2454): Client=jenkins//172.31.2.20 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-21 13:54:44,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:44,542 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-21 13:54:44,543 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-21 13:54:44,543 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-21 13:54:44,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-21 13:54:44,548 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fb33e3664562b9c0ab00fae49dcf8a20, REOPEN/MOVE}] 2023-11-21 13:54:44,548 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fb33e3664562b9c0ab00fae49dcf8a20, REOPEN/MOVE 2023-11-21 13:54:44,549 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=fb33e3664562b9c0ab00fae49dcf8a20, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:44,549 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700574884549"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574884549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574884549"}]},"ts":"1700574884549"} 2023-11-21 13:54:44,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure fb33e3664562b9c0ab00fae49dcf8a20, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:54:44,702 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:44,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:44,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing fb33e3664562b9c0ab00fae49dcf8a20, disabling compactions & flushes 2023-11-21 13:54:44,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:44,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:44,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. after waiting 0 ms 2023-11-21 13:54:44,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:44,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-21 13:54:44,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:44,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:44,709 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(3510): Not adding moved region record: fb33e3664562b9c0ab00fae49dcf8a20 to self. 2023-11-21 13:54:44,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:44,711 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=fb33e3664562b9c0ab00fae49dcf8a20, regionState=CLOSED 2023-11-21 13:54:44,711 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700574884711"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574884711"}]},"ts":"1700574884711"} 2023-11-21 13:54:44,714 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=52, resume processing ppid=51 2023-11-21 13:54:44,714 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure fb33e3664562b9c0ab00fae49dcf8a20, server=jenkins-hbase6.apache.org,46365,1700574804408 in 162 msec 2023-11-21 13:54:44,714 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fb33e3664562b9c0ab00fae49dcf8a20, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=true 2023-11-21 13:54:44,865 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=fb33e3664562b9c0ab00fae49dcf8a20, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:44,865 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700574884865"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574884865"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574884865"}]},"ts":"1700574884865"} 2023-11-21 13:54:44,866 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure fb33e3664562b9c0ab00fae49dcf8a20, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:54:45,018 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:45,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:45,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fb33e3664562b9c0ab00fae49dcf8a20, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.', STARTKEY => '', ENDKEY => ''} 2023-11-21 13:54:45,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:45,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:54:45,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:45,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:45,022 INFO [StoreOpener-fb33e3664562b9c0ab00fae49dcf8a20-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:45,023 DEBUG [StoreOpener-fb33e3664562b9c0ab00fae49dcf8a20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1 2023-11-21 13:54:45,023 DEBUG [StoreOpener-fb33e3664562b9c0ab00fae49dcf8a20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1 2023-11-21 13:54:45,023 INFO [StoreOpener-fb33e3664562b9c0ab00fae49dcf8a20-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb33e3664562b9c0ab00fae49dcf8a20 columnFamilyName family1 2023-11-21 13:54:45,029 DEBUG [StoreOpener-fb33e3664562b9c0ab00fae49dcf8a20-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/1545062fab274b3aa292a3840834369b_SeqId_53_ 2023-11-21 13:54:45,032 DEBUG [StoreOpener-fb33e3664562b9c0ab00fae49dcf8a20-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/family1/d664ef04abb24ec1a507935ac988ff1f 2023-11-21 13:54:45,032 INFO [StoreOpener-fb33e3664562b9c0ab00fae49dcf8a20-1] regionserver.HStore(310): Store=fb33e3664562b9c0ab00fae49dcf8a20/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:54:45,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:45,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:45,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:54:45,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened fb33e3664562b9c0ab00fae49dcf8a20; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67049570, jitterRate=-8.835494518280029E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-21 13:54:45,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:54:45,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20., pid=53, masterSystemTime=1700574885018 2023-11-21 13:54:45,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:45,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:54:45,039 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=fb33e3664562b9c0ab00fae49dcf8a20, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:45,039 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700574885039"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574885039"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574885039"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574885039"}]},"ts":"1700574885039"} 2023-11-21 13:54:45,041 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=53, resume processing ppid=51 2023-11-21 13:54:45,041 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure fb33e3664562b9c0ab00fae49dcf8a20, server=jenkins-hbase6.apache.org,46365,1700574804408 in 174 msec 2023-11-21 13:54:45,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=51, resume processing ppid=50 2023-11-21 13:54:45,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fb33e3664562b9c0ab00fae49dcf8a20, REOPEN/MOVE in 494 msec 2023-11-21 13:54:45,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=50, resume processing ppid=49 2023-11-21 13:54:45,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 498 msec 2023-11-21 13:54:45,046 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 513 msec 2023-11-21 13:54:45,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-21 13:54:45,048 INFO [Listener at localhost/35077] compactions.TestMobCompactor(278): alter status finished 2023-11-21 13:54:45,049 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43219] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-21 13:54:45,050 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-21 13:54:45,051 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-21 13:54:45,051 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:54:45,051 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700575485051 2023-11-21 13:54:45,052 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-21 13:54:45,052 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-21 13:54:45,052 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-21 13:54:45,053 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] zookeeper.ReadOnlyZKClient(139): Connect 0x4a8aca70 to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:54:45,058 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5db7d8e9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:54:45,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:45,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:45,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:45,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:45,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:45,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:45,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:45,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-21 13:54:45,059 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-21 13:54:45,059 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:54:45,059 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-21 13:54:45,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 10 msec 2023-11-21 13:54:45,112 INFO [Listener at localhost/35077] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=248 (was 248), OpenFileDescriptor=655 (was 623) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=164 (was 209), ProcessCount=172 (was 174), AvailableMemoryMB=6996 (was 7004) 2023-11-21 13:54:45,124 INFO [Listener at localhost/35077] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=248, OpenFileDescriptor=655, MaxFileDescriptor=60000, SystemLoadAverage=164, ProcessCount=172, AvailableMemoryMB=6995 2023-11-21 13:54:45,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-21 13:54:45,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:45,128 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-21 13:54:45,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-21 13:54:45,128 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-21 13:54:45,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-21 13:54:45,130 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:45,130 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1 empty. 2023-11-21 13:54:45,130 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:45,130 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-21 13:54:45,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-21 13:54:45,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-21 13:54:45,538 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-21 13:54:45,539 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => be282b8f384cf5531c69d052b9de0fc1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:54:45,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-21 13:54:45,944 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:54:45,944 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing be282b8f384cf5531c69d052b9de0fc1, disabling compactions & flushes 2023-11-21 13:54:45,944 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:45,944 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:45,944 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. after waiting 0 ms 2023-11-21 13:54:45,944 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:45,944 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:45,944 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:45,947 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-21 13:54:45,947 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700574885947"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574885947"}]},"ts":"1700574885947"} 2023-11-21 13:54:45,949 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-21 13:54:45,949 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-21 13:54:45,949 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574885949"}]},"ts":"1700574885949"} 2023-11-21 13:54:45,950 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-21 13:54:45,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=be282b8f384cf5531c69d052b9de0fc1, ASSIGN}] 2023-11-21 13:54:45,959 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=be282b8f384cf5531c69d052b9de0fc1, ASSIGN 2023-11-21 13:54:45,959 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=be282b8f384cf5531c69d052b9de0fc1, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:54:46,110 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=be282b8f384cf5531c69d052b9de0fc1, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:46,111 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700574886110"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574886110"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574886110"}]},"ts":"1700574886110"} 2023-11-21 13:54:46,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure be282b8f384cf5531c69d052b9de0fc1, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:54:46,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-21 13:54:46,264 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:46,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:46,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => be282b8f384cf5531c69d052b9de0fc1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.', STARTKEY => '', ENDKEY => ''} 2023-11-21 13:54:46,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:46,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:54:46,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:46,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:46,268 INFO [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:46,270 DEBUG [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1 2023-11-21 13:54:46,270 DEBUG [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1 2023-11-21 13:54:46,270 INFO [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be282b8f384cf5531c69d052b9de0fc1 columnFamilyName family1 2023-11-21 13:54:46,271 INFO [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] regionserver.HStore(310): Store=be282b8f384cf5531c69d052b9de0fc1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:54:46,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:46,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:46,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:46,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:54:46,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened be282b8f384cf5531c69d052b9de0fc1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63312520, jitterRate=-0.05656993389129639}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-21 13:54:46,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:46,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1., pid=57, masterSystemTime=1700574886264 2023-11-21 13:54:46,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:46,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:46,280 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=be282b8f384cf5531c69d052b9de0fc1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:46,280 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700574886280"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574886280"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574886280"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574886280"}]},"ts":"1700574886280"} 2023-11-21 13:54:46,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=57, resume processing ppid=56 2023-11-21 13:54:46,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure be282b8f384cf5531c69d052b9de0fc1, server=jenkins-hbase6.apache.org,46365,1700574804408 in 169 msec 2023-11-21 13:54:46,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=56, resume processing ppid=55 2023-11-21 13:54:46,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=be282b8f384cf5531c69d052b9de0fc1, ASSIGN in 326 msec 2023-11-21 13:54:46,285 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-21 13:54:46,286 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574886285"}]},"ts":"1700574886285"} 2023-11-21 13:54:46,286 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-21 13:54:46,289 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-21 13:54:46,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1630 sec 2023-11-21 13:54:47,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-21 13:54:47,233 INFO [Listener at localhost/35077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-21 13:54:47,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:47,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:47,253 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:47,253 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:47,253 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-21 13:54:47,253 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-21 13:54:47,254 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:47,254 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:47,256 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:47,256 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:47,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:47,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:47,257 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:47,257 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:47,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:47,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:47,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:47,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:47,257 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:47,258 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:47,258 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-21 13:54:47,258 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:47,258 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-21 13:54:47,258 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:47,258 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:47,258 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:47,258 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. started... 2023-11-21 13:54:47,259 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing be282b8f384cf5531c69d052b9de0fc1 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-21 13:54:47,677 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511300a7dfb6b2b454f69a6387cfa818256df to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511300a7dfb6b2b454f69a6387cfa818256df 2023-11-21 13:54:48,081 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/c0dbd30e50df41fe8ac0bf65c2e9df9e 2023-11-21 13:54:48,086 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/c0dbd30e50df41fe8ac0bf65c2e9df9e as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/c0dbd30e50df41fe8ac0bf65c2e9df9e 2023-11-21 13:54:48,091 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/c0dbd30e50df41fe8ac0bf65c2e9df9e, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-21 13:54:48,092 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for be282b8f384cf5531c69d052b9de0fc1 in 833ms, sequenceid=5, compaction requested=false 2023-11-21 13:54:48,092 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:48,093 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:48,093 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:48,093 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:48,093 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:48,093 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:48,093 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-21 13:54:48,093 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-21 13:54:48,095 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:48,095 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:48,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:48,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:48,095 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,096 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:48,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:48,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:48,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:48,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:48,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-21 13:54:48,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7182b26a[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:48,097 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-21 13:54:48,097 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,099 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,099 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-21 13:54:48,099 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-21 13:54:48,099 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:48,099 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:48,099 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:48,100 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:48,101 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-21 13:54:48,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:48,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:48,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:48,101 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:48,101 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-21 13:54:48,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:48,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:48,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:48,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:48,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:48,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:48,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-21 13:54:48,103 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-21 13:54:48,103 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:48,103 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:48,103 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,103 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:48,108 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,108 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:48,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:48,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,108 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:48,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:48,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:48,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:48,109 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:48,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:48,110 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:48,112 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:48,112 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,112 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,112 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:48,112 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:48,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:48,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:48,112 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:48,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-21 13:54:48,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:48,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:48,113 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:48,113 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:48,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:48,113 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,113 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,113 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:48,113 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:48,213 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:48,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:48,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:48,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:48,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,219 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:48,219 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:48,220 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-21 13:54:48,220 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-21 13:54:48,220 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,220 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,221 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:48,221 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:48,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:48,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:48,222 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:48,222 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:48,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:48,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,223 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,223 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-21 13:54:48,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:48,223 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-21 13:54:48,223 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:48,223 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-21 13:54:48,223 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:48,223 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:48,223 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:48,223 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. started... 2023-11-21 13:54:48,223 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing be282b8f384cf5531c69d052b9de0fc1 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-21 13:54:48,635 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f97fdfe74acd4e07a471fbf88f189722 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128f97fdfe74acd4e07a471fbf88f189722 2023-11-21 13:54:48,774 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-21 13:54:49,040 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/54cf1ede5a6f46abb7bbf935c18bda64 2023-11-21 13:54:49,045 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/54cf1ede5a6f46abb7bbf935c18bda64 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/54cf1ede5a6f46abb7bbf935c18bda64 2023-11-21 13:54:49,049 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/54cf1ede5a6f46abb7bbf935c18bda64, entries=1, sequenceid=9, filesize=5.0 K 2023-11-21 13:54:49,050 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for be282b8f384cf5531c69d052b9de0fc1 in 827ms, sequenceid=9, compaction requested=false 2023-11-21 13:54:49,050 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:49,050 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:49,050 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:49,050 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:49,050 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:49,050 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-21 13:54:49,050 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-21 13:54:49,053 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:49,053 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:49,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:49,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:49,053 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,053 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:49,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:49,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:49,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:49,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:49,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-21 13:54:49,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e487bea[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:49,055 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-21 13:54:49,055 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,056 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,056 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-21 13:54:49,056 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-21 13:54:49,056 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:49,056 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:49,057 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:49,058 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-21 13:54:49,058 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:49,058 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:49,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:49,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:49,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:49,058 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-21 13:54:49,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:49,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:49,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:49,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:49,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:49,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:49,061 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-21 13:54:49,061 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:49,061 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:49,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-21 13:54:49,061 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,061 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:49,062 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,062 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,062 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:49,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:49,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:49,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:49,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:49,063 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:49,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:49,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:49,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,064 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:49,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:49,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:49,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:49,067 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:49,067 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,067 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:49,067 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:49,067 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:49,067 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:49,067 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:49,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-21 13:54:49,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:49,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:49,067 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:49,068 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,068 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,068 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:49,068 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:49,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:49,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:49,168 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:49,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:49,172 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:49,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:49,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,173 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:49,173 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:49,173 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-21 13:54:49,173 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-21 13:54:49,174 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,174 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,175 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:49,175 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:49,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:49,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:49,175 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:49,175 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:49,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:49,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,176 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,176 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-21 13:54:49,176 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:49,177 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-21 13:54:49,177 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:49,177 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-21 13:54:49,177 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:49,177 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:49,177 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:49,177 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. started... 2023-11-21 13:54:49,177 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing be282b8f384cf5531c69d052b9de0fc1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:49,588 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201b882f338514246f0bc7c54dafe684ae1 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201b882f338514246f0bc7c54dafe684ae1 2023-11-21 13:54:49,994 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/ecc81d308380487da861bdd095897d7e 2023-11-21 13:54:49,998 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/ecc81d308380487da861bdd095897d7e as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/ecc81d308380487da861bdd095897d7e 2023-11-21 13:54:50,002 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/ecc81d308380487da861bdd095897d7e, entries=1, sequenceid=13, filesize=5.0 K 2023-11-21 13:54:50,003 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for be282b8f384cf5531c69d052b9de0fc1 in 826ms, sequenceid=13, compaction requested=true 2023-11-21 13:54:50,003 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:50,003 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:50,004 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:50,004 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:50,004 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,004 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-21 13:54:50,004 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-21 13:54:50,005 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,006 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:50,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:50,006 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,006 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:50,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:50,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:50,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:50,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-21 13:54:50,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@405daf56[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:50,008 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-21 13:54:50,008 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,009 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,009 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-21 13:54:50,009 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-21 13:54:50,009 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:50,010 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,010 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:50,012 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,012 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-21 13:54:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,012 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:50,012 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-21 13:54:50,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:50,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:50,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:50,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:50,015 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-21 13:54:50,015 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:50,015 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:50,015 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-21 13:54:50,015 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:50,017 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,017 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,017 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:50,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:50,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:50,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:50,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:50,018 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:50,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:50,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,019 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:50,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,027 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,027 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,027 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:50,027 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,027 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:50,027 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:50,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:50,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:50,027 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,027 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:50,027 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,027 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:50,028 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:50,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:50,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-21 13:54:50,027 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:50,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:50,128 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:50,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:50,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:50,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:50,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,133 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:50,133 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:50,133 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-21 13:54:50,133 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-21 13:54:50,134 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,134 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,138 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,138 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:50,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:50,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:50,139 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,139 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:50,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:50,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,140 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,140 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-21 13:54:50,140 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,140 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-21 13:54:50,140 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:50,140 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-21 13:54:50,140 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:50,140 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:50,140 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:50,140 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. started... 2023-11-21 13:54:50,140 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing be282b8f384cf5531c69d052b9de0fc1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:50,552 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512054f49fff7077b474398146cda415828db to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512054f49fff7077b474398146cda415828db 2023-11-21 13:54:50,957 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/c6540956bdb9405c97c9539b2d557f25 2023-11-21 13:54:50,962 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/c6540956bdb9405c97c9539b2d557f25 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/c6540956bdb9405c97c9539b2d557f25 2023-11-21 13:54:50,966 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/c6540956bdb9405c97c9539b2d557f25, entries=1, sequenceid=17, filesize=5.0 K 2023-11-21 13:54:50,967 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for be282b8f384cf5531c69d052b9de0fc1 in 827ms, sequenceid=17, compaction requested=true 2023-11-21 13:54:50,967 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:50,967 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:50,967 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:50,967 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:50,967 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,967 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-21 13:54:50,967 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-21 13:54:50,969 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,969 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:50,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:50,969 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,969 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:50,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:50,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:50,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:50,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-21 13:54:50,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@739d7e5c[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:50,971 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-21 13:54:50,971 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,972 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,973 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-21 13:54:50,973 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-21 13:54:50,973 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,973 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:50,973 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:50,975 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,975 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-21 13:54:50,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:50,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:50,975 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:50,975 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-21 13:54:50,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:50,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:50,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:50,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:50,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-21 13:54:50,978 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-21 13:54:50,978 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:50,978 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:50,978 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,978 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:50,980 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,980 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,980 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:50,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:50,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:50,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:50,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:50,980 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:50,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:50,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,982 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:50,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,984 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,984 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:50,984 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:50,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:50,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:50,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:50,984 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,984 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:50,984 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-21 13:54:50,984 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:50,984 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:50,984 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:50,984 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:50,984 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:50,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:50,985 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:50,985 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,085 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:51,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:51,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:51,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:51,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,091 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:51,091 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:51,091 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-21 13:54:51,091 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-21 13:54:51,091 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,091 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,092 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:51,092 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:51,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:51,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:51,093 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:51,093 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:51,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:51,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,094 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,094 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-21 13:54:51,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,094 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-21 13:54:51,094 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:51,094 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-21 13:54:51,094 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:51,094 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:51,094 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:51,094 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. started... 2023-11-21 13:54:51,094 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing be282b8f384cf5531c69d052b9de0fc1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:51,507 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228e0dde840db544d228969032e0f3842a1 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228e0dde840db544d228969032e0f3842a1 2023-11-21 13:54:51,914 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/3863323105d849f19a6893e9af8ce7a3 2023-11-21 13:54:51,918 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/3863323105d849f19a6893e9af8ce7a3 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/3863323105d849f19a6893e9af8ce7a3 2023-11-21 13:54:51,922 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/3863323105d849f19a6893e9af8ce7a3, entries=1, sequenceid=21, filesize=5.0 K 2023-11-21 13:54:51,923 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for be282b8f384cf5531c69d052b9de0fc1 in 829ms, sequenceid=21, compaction requested=true 2023-11-21 13:54:51,923 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:51,923 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:51,923 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:51,923 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:51,923 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:51,923 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-21 13:54:51,923 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-21 13:54:51,925 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:51,925 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:51,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:51,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:51,925 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:51,925 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:51,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:51,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:51,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:51,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-21 13:54:51,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17e883a7[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:51,927 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-21 13:54:51,927 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,928 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,928 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-21 13:54:51,928 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-21 13:54:51,928 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:51,928 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:51,928 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:51,929 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-21 13:54:51,929 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:51,929 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:51,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:51,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:51,930 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-21 13:54:51,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:51,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:51,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:51,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:51,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:51,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:51,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:51,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-21 13:54:51,932 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-21 13:54:51,932 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:51,932 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:51,932 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,932 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:51,934 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,934 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:51,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:51,934 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:51,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:51,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:51,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:51,935 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:51,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:51,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,936 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:51,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:51,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:51,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:51,938 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:51,938 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,938 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:51,938 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,938 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:51,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-21 13:54:51,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:51,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:51,938 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:51,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:51,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:51,938 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:51,939 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,939 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,939 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:51,939 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:51,939 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:51,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:51,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:52,039 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:52,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:52,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:52,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:52,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,044 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:52,044 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:52,044 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-21 13:54:52,044 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-21 13:54:52,045 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,045 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,046 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:52,046 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:52,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:52,047 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:52,047 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,047 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,048 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,048 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-21 13:54:52,048 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,048 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-21 13:54:52,048 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:52,048 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-21 13:54:52,048 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:52,048 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:52,048 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:52,048 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. started... 2023-11-21 13:54:52,048 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing be282b8f384cf5531c69d052b9de0fc1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:52,460 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123191894b7ceefd440da848df2f7d292203 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123191894b7ceefd440da848df2f7d292203 2023-11-21 13:54:52,865 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/54c283a297b645e3b5c0d8c572ffeb18 2023-11-21 13:54:52,870 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/54c283a297b645e3b5c0d8c572ffeb18 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/54c283a297b645e3b5c0d8c572ffeb18 2023-11-21 13:54:52,873 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/54c283a297b645e3b5c0d8c572ffeb18, entries=1, sequenceid=25, filesize=5.0 K 2023-11-21 13:54:52,874 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for be282b8f384cf5531c69d052b9de0fc1 in 826ms, sequenceid=25, compaction requested=true 2023-11-21 13:54:52,874 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:52,874 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:52,875 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:52,875 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:52,875 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:52,875 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-21 13:54:52,875 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-21 13:54:52,877 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,877 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:52,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:52,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:52,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:52,878 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,878 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:52,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:52,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:52,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:52,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:52,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-21 13:54:52,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a223d9b[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:52,879 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-21 13:54:52,879 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,880 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,880 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-21 13:54:52,880 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-21 13:54:52,880 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:52,881 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:52,880 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:52,882 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-21 13:54:52,882 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:52,882 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:52,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:52,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:52,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:52,882 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-21 13:54:52,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:52,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:52,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:52,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:52,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:52,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:52,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-21 13:54:52,884 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-21 13:54:52,884 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:52,884 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:52,884 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,884 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:52,886 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,886 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:52,886 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:52,887 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:52,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:52,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:52,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:52,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:52,888 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:52,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:52,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:52,892 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:52,892 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,892 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:52,892 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:52,892 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:52,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:52,892 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:52,892 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,892 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:52,892 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,892 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:52,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:52,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:52,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:52,893 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:52,893 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:52,993 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:52,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:52,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:52,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:52,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,999 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:52,999 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:52,999 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-21 13:54:52,999 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-21 13:54:52,999 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:52,999 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,001 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,001 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:53,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:53,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:53,001 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,001 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,002 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,002 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,003 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-21 13:54:53,003 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,003 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-21 13:54:53,003 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:53,003 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-21 13:54:53,003 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:53,003 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:53,003 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:53,003 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. started... 2023-11-21 13:54:53,003 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing be282b8f384cf5531c69d052b9de0fc1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:53,019 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f8db9577978b40a0ba95297fdee12268 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101f8db9577978b40a0ba95297fdee12268 2023-11-21 13:54:53,028 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/36c490e7772248f5992225abc07ef0a8 2023-11-21 13:54:53,032 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/36c490e7772248f5992225abc07ef0a8 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/36c490e7772248f5992225abc07ef0a8 2023-11-21 13:54:53,035 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/36c490e7772248f5992225abc07ef0a8, entries=1, sequenceid=29, filesize=5.0 K 2023-11-21 13:54:53,036 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for be282b8f384cf5531c69d052b9de0fc1 in 33ms, sequenceid=29, compaction requested=true 2023-11-21 13:54:53,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:53,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:53,036 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:53,036 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:53,037 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,037 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-21 13:54:53,037 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-21 13:54:53,038 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,038 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:53,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:53,039 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,039 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:53,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:53,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:53,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:53,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-21 13:54:53,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67280c96[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:53,040 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-21 13:54:53,040 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,041 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,042 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-21 13:54:53,042 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,042 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:53,042 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-21 13:54:53,042 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:53,044 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,044 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-21 13:54:53,044 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:53,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,044 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-21 13:54:53,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:53,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:53,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:53,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:53,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:53,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:53,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-21 13:54:53,047 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-21 13:54:53,047 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:53,047 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:53,047 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,047 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:53,049 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,049 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:53,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:53,049 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:53,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:53,049 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:53,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:53,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:53,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,051 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:53,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,053 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,053 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:53,053 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:53,053 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:53,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-21 13:54:53,053 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:53,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:53,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:53,053 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:53,053 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:53,053 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:53,053 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,054 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:53,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:53,054 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,054 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,154 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:53,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:53,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:53,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:53,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,160 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:53,160 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:53,160 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-21 13:54:53,160 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-21 13:54:53,160 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,160 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,162 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:53,162 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:53,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:53,162 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,162 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:53,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:53,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,163 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,163 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-21 13:54:53,163 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,163 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-21 13:54:53,163 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:53,163 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-21 13:54:53,164 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:53,164 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:53,164 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:53,164 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. started... 2023-11-21 13:54:53,164 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing be282b8f384cf5531c69d052b9de0fc1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:53,576 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010377fa24731c1e4e45baa870c7d18f4632 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010377fa24731c1e4e45baa870c7d18f4632 2023-11-21 13:54:53,981 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/f150927587a742f2a836edc06f83aa1d 2023-11-21 13:54:53,986 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/f150927587a742f2a836edc06f83aa1d as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/f150927587a742f2a836edc06f83aa1d 2023-11-21 13:54:53,991 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/f150927587a742f2a836edc06f83aa1d, entries=1, sequenceid=33, filesize=5.0 K 2023-11-21 13:54:53,992 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for be282b8f384cf5531c69d052b9de0fc1 in 828ms, sequenceid=33, compaction requested=true 2023-11-21 13:54:53,992 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:53,992 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:53,992 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:53,992 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:53,992 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,992 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-21 13:54:53,992 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-21 13:54:53,995 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:53,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:53,995 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:53,996 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,996 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:53,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:53,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:53,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-21 13:54:53,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fdff1b1[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:53,997 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-21 13:54:53,997 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,999 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:53,999 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-21 13:54:53,999 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-21 13:54:53,999 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:53,999 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:53,999 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:54,003 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-21 13:54:54,003 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:54,003 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,003 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-21 13:54:54,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:54,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:54,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:54,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:54,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:54,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:54,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-21 13:54:54,006 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-21 13:54:54,006 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:54,006 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:54,006 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,006 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:54,008 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,008 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,008 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:54,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:54,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:54,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:54,009 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:54,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:54,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:54,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,010 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:54,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,013 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,013 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:54,013 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,013 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:54,013 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:54,013 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:54,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:54,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:54,013 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:54,014 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,014 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,014 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,014 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:54,014 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:54,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:54,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:54,114 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:54,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:54,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:54,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:54,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,120 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:54,120 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:54,120 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-21 13:54:54,120 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-21 13:54:54,120 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,120 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,123 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,123 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:54,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:54,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:54,123 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,123 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:54,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:54,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,124 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,124 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-21 13:54:54,124 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,124 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-21 13:54:54,125 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:54,125 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-21 13:54:54,125 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:54,125 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:54,125 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:54,125 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. started... 2023-11-21 13:54:54,125 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing be282b8f384cf5531c69d052b9de0fc1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:54,542 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509078287c53b387744ce9fbea6ad43830135 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509078287c53b387744ce9fbea6ad43830135 2023-11-21 13:54:54,949 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/4f3fdb46129a4a9ba7a3ae0c378a7257 2023-11-21 13:54:54,954 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/4f3fdb46129a4a9ba7a3ae0c378a7257 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/4f3fdb46129a4a9ba7a3ae0c378a7257 2023-11-21 13:54:54,957 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/4f3fdb46129a4a9ba7a3ae0c378a7257, entries=1, sequenceid=37, filesize=5.0 K 2023-11-21 13:54:54,958 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for be282b8f384cf5531c69d052b9de0fc1 in 833ms, sequenceid=37, compaction requested=true 2023-11-21 13:54:54,958 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:54,958 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:54,958 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:54,958 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:54,958 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,958 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-21 13:54:54,958 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-21 13:54:54,960 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,960 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:54,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:54,960 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,960 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:54,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:54,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-21 13:54:54,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c79a056[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:54,962 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-21 13:54:54,962 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,963 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,963 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-21 13:54:54,963 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-21 13:54:54,963 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:54,963 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,963 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:54,965 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-21 13:54:54,965 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:54,965 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,965 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-21 13:54:54,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:54,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:54,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:54,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:54,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:54,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:54,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-21 13:54:54,967 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-21 13:54:54,967 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:54,967 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:54,967 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,967 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:54,970 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,970 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:54,970 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:54,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:54,970 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:54,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,972 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:54,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,974 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,974 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,974 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:54,974 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:54,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:54,974 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:54,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:54,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:54,974 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:54,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-21 13:54:54,991 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:54,992 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:54,992 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-21 13:54:54,992 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:54,992 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51c56dcc to 127.0.0.1:52369 2023-11-21 13:54:54,992 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,992 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:54:54,992 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:54,992 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a8aca70 to 127.0.0.1:52369 2023-11-21 13:54:54,992 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:54:54,992 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:54,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:54,993 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-21 13:54:54,993 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27c74d9c to 127.0.0.1:52369 2023-11-21 13:54:54,993 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:54:54,993 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-21 13:54:54,993 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1aa8a9d1 to 127.0.0.1:52369 2023-11-21 13:54:54,993 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:54:55,093 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:55,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:55,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:54:55,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-21 13:54:55,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,099 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:55,099 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:55,099 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-21 13:54:55,099 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-21 13:54:55,100 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,100 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,102 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:55,102 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:55,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:55,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:55,102 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:55,102 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:54:55,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:54:55,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,103 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,104 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,104 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-21 13:54:55,104 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:54:55,104 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-21 13:54:55,104 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:54:55,104 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:54:55,104 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:55,104 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. started... 2023-11-21 13:54:55,104 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing be282b8f384cf5531c69d052b9de0fc1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:54:55,520 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e91b373602dc429eb9fb5ad6703c6335 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120e91b373602dc429eb9fb5ad6703c6335 2023-11-21 13:54:55,925 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/6e68bf8b9bff48af8296aa8280965179 2023-11-21 13:54:55,929 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/6e68bf8b9bff48af8296aa8280965179 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/6e68bf8b9bff48af8296aa8280965179 2023-11-21 13:54:55,933 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/6e68bf8b9bff48af8296aa8280965179, entries=1, sequenceid=41, filesize=5.0 K 2023-11-21 13:54:55,934 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for be282b8f384cf5531c69d052b9de0fc1 in 829ms, sequenceid=41, compaction requested=true 2023-11-21 13:54:55,934 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:55,934 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:55,934 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:54:55,934 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:54:55,934 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:55,934 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-21 13:54:55,934 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-21 13:54:55,936 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:55,936 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:55,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:55,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:55,936 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,936 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:54:55,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:55,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:55,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:55,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:55,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-21 13:54:55,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77ec9ea7[Count = 0] remaining members to acquire global barrier 2023-11-21 13:54:55,937 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-21 13:54:55,937 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,938 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,939 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-21 13:54:55,939 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-21 13:54:55,939 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:54:55,939 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:55,939 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:54:55,940 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:55,940 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-21 13:54:55,940 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:55,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:55,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:55,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:55,940 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-21 13:54:55,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:55,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:55,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:55,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:55,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:55,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:54:55,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-21 13:54:55,943 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-21 13:54:55,943 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:54:55,943 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:54:55,943 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,943 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:54:55,955 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,955 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:54:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:54:55,955 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:55,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:55,955 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:54:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:54:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,956 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:54:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:55,959 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:55,959 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,959 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,959 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:54:55,959 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:55,959 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:54:55,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-21 13:54:55,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:54:55,959 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,959 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-21 13:54:55,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:54:55,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:54:55,959 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:54:55,959 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,959 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-21 13:54:55,959 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:54:55,959 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:55,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:54:55,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:54:56,059 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:54:56,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:54:56,061 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43219] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:56,062 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-21 13:54:56,063 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-21 13:54:56,064 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:54:56,064 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700575496064 2023-11-21 13:54:56,065 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-21 13:54:56,065 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-21 13:54:56,065 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-21 13:54:56,067 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] zookeeper.ReadOnlyZKClient(139): Connect 0x490e8a71 to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:54:56,071 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7aa83bf0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:54:56,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:54:56,904 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032fb4e52df57a40a38cc4f12eb7fc5199 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601032fb4e52df57a40a38cc4f12eb7fc5199 2023-11-21 13:54:56,905 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-21 13:54:56,917 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:54:56,918 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:36832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:54:56,925 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-21 13:54:56,925 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:52972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-21 13:54:56,933 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4dbb477a0645443594583f3cf0de0ba4 first=Optional[r3] last=Optional[r6] 2023-11-21 13:54:56,933 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4dbb477a0645443594583f3cf0de0ba4}] 2023-11-21 13:54:56,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4dbb477a0645443594583f3cf0de0ba4 for inclusion in be282b8f384cf5531c69d052b9de0fc1/family1 2023-11-21 13:54:56,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-21 13:54:56,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:54:56,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:56,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4dbb477a0645443594583f3cf0de0ba4 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ugbh0kpvfaddvg6jan7bd6hsnbndte14ldiq4eftbgeodd3lho64neaa1vg2s7l5/family1/4dbb477a0645443594583f3cf0de0ba4 2023-11-21 13:54:56,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ugbh0kpvfaddvg6jan7bd6hsnbndte14ldiq4eftbgeodd3lho64neaa1vg2s7l5/family1/4dbb477a0645443594583f3cf0de0ba4 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/db9002d2af4f4e418d9256c3ad0e9020_SeqId_44_ 2023-11-21 13:54:56,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ugbh0kpvfaddvg6jan7bd6hsnbndte14ldiq4eftbgeodd3lho64neaa1vg2s7l5/family1/4dbb477a0645443594583f3cf0de0ba4 into be282b8f384cf5531c69d052b9de0fc1/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/db9002d2af4f4e418d9256c3ad0e9020_SeqId_44_ - updating store file list. 2023-11-21 13:54:56,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/db9002d2af4f4e418d9256c3ad0e9020_SeqId_44_ into be282b8f384cf5531c69d052b9de0fc1/family1 2023-11-21 13:54:56,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ugbh0kpvfaddvg6jan7bd6hsnbndte14ldiq4eftbgeodd3lho64neaa1vg2s7l5/family1/4dbb477a0645443594583f3cf0de0ba4 into be282b8f384cf5531c69d052b9de0fc1/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/db9002d2af4f4e418d9256c3ad0e9020_SeqId_44_) 2023-11-21 13:54:56,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ugbh0kpvfaddvg6jan7bd6hsnbndte14ldiq4eftbgeodd3lho64neaa1vg2s7l5/family1/4dbb477a0645443594583f3cf0de0ba4 2023-11-21 13:54:56,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-21 13:54:56,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-21 13:54:56,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(1912): be282b8f384cf5531c69d052b9de0fc1/family1 is initiating minor compaction 2023-11-21 13:54:56,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3c11c5da; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:54:56,949 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of be282b8f384cf5531c69d052b9de0fc1/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:56,949 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/54cf1ede5a6f46abb7bbf935c18bda64, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/ecc81d308380487da861bdd095897d7e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/c6540956bdb9405c97c9539b2d557f25, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/3863323105d849f19a6893e9af8ce7a3, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/54c283a297b645e3b5c0d8c572ffeb18, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/36c490e7772248f5992225abc07ef0a8, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/f150927587a742f2a836edc06f83aa1d, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/4f3fdb46129a4a9ba7a3ae0c378a7257, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/6e68bf8b9bff48af8296aa8280965179, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/db9002d2af4f4e418d9256c3ad0e9020_SeqId_44_] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp, totalSize=50.3 K 2023-11-21 13:54:56,949 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 54cf1ede5a6f46abb7bbf935c18bda64, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-21 13:54:56,949 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting ecc81d308380487da861bdd095897d7e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-21 13:54:56,949 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting c6540956bdb9405c97c9539b2d557f25, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-21 13:54:56,950 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 3863323105d849f19a6893e9af8ce7a3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-21 13:54:56,950 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 54c283a297b645e3b5c0d8c572ffeb18, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-21 13:54:56,950 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 36c490e7772248f5992225abc07ef0a8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-21 13:54:56,950 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting f150927587a742f2a836edc06f83aa1d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-21 13:54:56,950 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 4f3fdb46129a4a9ba7a3ae0c378a7257, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-21 13:54:56,950 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 6e68bf8b9bff48af8296aa8280965179, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-21 13:54:56,950 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting db9002d2af4f4e418d9256c3ad0e9020_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-21 13:54:56,951 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-21 13:54:56,952 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:56,953 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228e0dde840db544d228969032e0f3842a1 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228e0dde840db544d228969032e0f3842a1 2023-11-21 13:54:56,955 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123191894b7ceefd440da848df2f7d292203 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123191894b7ceefd440da848df2f7d292203 2023-11-21 13:54:56,956 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101f8db9577978b40a0ba95297fdee12268 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101f8db9577978b40a0ba95297fdee12268 2023-11-21 13:54:56,957 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010377fa24731c1e4e45baa870c7d18f4632 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010377fa24731c1e4e45baa870c7d18f4632 2023-11-21 13:54:56,957 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-21 13:54:56,957 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-21 13:54:56,957 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:54:56,957 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:54:56,957 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:54:56,957 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:54:56,957 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:54:56,957 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:54:56,957 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:54:56,957 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:54:56,979 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): be282b8f384cf5531c69d052b9de0fc1#family1#compaction#73 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-21 13:54:57,402 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b9236495b50541c29aef3a6b477af70b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205b9236495b50541c29aef3a6b477af70b 2023-11-21 13:54:57,403 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-21 13:54:57,426 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0518952a2b234724a100b6c310353115 first=Optional[r00] last=Optional[r2] 2023-11-21 13:54:57,427 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0518952a2b234724a100b6c310353115}] 2023-11-21 13:54:57,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0518952a2b234724a100b6c310353115 for inclusion in be282b8f384cf5531c69d052b9de0fc1/family1 2023-11-21 13:54:57,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-21 13:54:57,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:54:57,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:57,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0518952a2b234724a100b6c310353115 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__qce71njgiijf5refgmj65vvf21es4226k0rjjill5llsrj48ooalavgtadg2viru/family1/0518952a2b234724a100b6c310353115 2023-11-21 13:54:57,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__qce71njgiijf5refgmj65vvf21es4226k0rjjill5llsrj48ooalavgtadg2viru/family1/0518952a2b234724a100b6c310353115 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/a806c0a00e9243a98913fadaabefe84d_SeqId_46_ 2023-11-21 13:54:57,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__qce71njgiijf5refgmj65vvf21es4226k0rjjill5llsrj48ooalavgtadg2viru/family1/0518952a2b234724a100b6c310353115 into be282b8f384cf5531c69d052b9de0fc1/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/a806c0a00e9243a98913fadaabefe84d_SeqId_46_ - updating store file list. 2023-11-21 13:54:57,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/a806c0a00e9243a98913fadaabefe84d_SeqId_46_ into be282b8f384cf5531c69d052b9de0fc1/family1 2023-11-21 13:54:57,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__qce71njgiijf5refgmj65vvf21es4226k0rjjill5llsrj48ooalavgtadg2viru/family1/0518952a2b234724a100b6c310353115 into be282b8f384cf5531c69d052b9de0fc1/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/a806c0a00e9243a98913fadaabefe84d_SeqId_46_) 2023-11-21 13:54:57,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__qce71njgiijf5refgmj65vvf21es4226k0rjjill5llsrj48ooalavgtadg2viru/family1/0518952a2b234724a100b6c310353115 2023-11-21 13:54:57,441 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-21 13:54:57,442 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:57,443 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511300a7dfb6b2b454f69a6387cfa818256df to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511300a7dfb6b2b454f69a6387cfa818256df 2023-11-21 13:54:57,444 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201b882f338514246f0bc7c54dafe684ae1 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201b882f338514246f0bc7c54dafe684ae1 2023-11-21 13:54:57,445 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512054f49fff7077b474398146cda415828db to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512054f49fff7077b474398146cda415828db 2023-11-21 13:54:57,445 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-21 13:54:57,445 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-21 13:54:57,446 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:54:57,446 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-21 13:54:57,446 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:54:57,447 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-21 13:54:57,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.3850 sec 2023-11-21 13:54:57,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$12(2454): Client=jenkins//172.31.2.20 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-21 13:54:57,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:57,796 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/2c8c59a3cf3e4773a0b247c55a12a300 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/2c8c59a3cf3e4773a0b247c55a12a300 2023-11-21 13:54:57,800 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in be282b8f384cf5531c69d052b9de0fc1/family1 of be282b8f384cf5531c69d052b9de0fc1 into 2c8c59a3cf3e4773a0b247c55a12a300(size=6.8 K), total size for store is 388.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:54:57,800 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:57,800 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1700574896949; duration=0sec 2023-11-21 13:54:57,801 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:54:57,901 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/54cf1ede5a6f46abb7bbf935c18bda64, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/ecc81d308380487da861bdd095897d7e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/c6540956bdb9405c97c9539b2d557f25, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/3863323105d849f19a6893e9af8ce7a3, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/54c283a297b645e3b5c0d8c572ffeb18, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/36c490e7772248f5992225abc07ef0a8, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/f150927587a742f2a836edc06f83aa1d, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/4f3fdb46129a4a9ba7a3ae0c378a7257, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/6e68bf8b9bff48af8296aa8280965179, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/db9002d2af4f4e418d9256c3ad0e9020_SeqId_44_] to archive 2023-11-21 13:54:57,902 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:57,904 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/54cf1ede5a6f46abb7bbf935c18bda64 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/54cf1ede5a6f46abb7bbf935c18bda64 2023-11-21 13:54:57,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/ecc81d308380487da861bdd095897d7e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/ecc81d308380487da861bdd095897d7e 2023-11-21 13:54:57,906 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/c6540956bdb9405c97c9539b2d557f25 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/c6540956bdb9405c97c9539b2d557f25 2023-11-21 13:54:57,907 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/3863323105d849f19a6893e9af8ce7a3 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/3863323105d849f19a6893e9af8ce7a3 2023-11-21 13:54:57,908 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/54c283a297b645e3b5c0d8c572ffeb18 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/54c283a297b645e3b5c0d8c572ffeb18 2023-11-21 13:54:57,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/36c490e7772248f5992225abc07ef0a8 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/36c490e7772248f5992225abc07ef0a8 2023-11-21 13:54:57,910 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/f150927587a742f2a836edc06f83aa1d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/f150927587a742f2a836edc06f83aa1d 2023-11-21 13:54:57,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/4f3fdb46129a4a9ba7a3ae0c378a7257 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/4f3fdb46129a4a9ba7a3ae0c378a7257 2023-11-21 13:54:57,912 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/6e68bf8b9bff48af8296aa8280965179 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/6e68bf8b9bff48af8296aa8280965179 2023-11-21 13:54:57,913 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/db9002d2af4f4e418d9256c3ad0e9020_SeqId_44_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/db9002d2af4f4e418d9256c3ad0e9020_SeqId_44_ 2023-11-21 13:54:57,940 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-21 13:54:57,940 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-21 13:54:57,940 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-21 13:54:57,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-21 13:54:57,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=be282b8f384cf5531c69d052b9de0fc1, REOPEN/MOVE}] 2023-11-21 13:54:57,945 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=be282b8f384cf5531c69d052b9de0fc1, REOPEN/MOVE 2023-11-21 13:54:57,945 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=be282b8f384cf5531c69d052b9de0fc1, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:57,945 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700574897945"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574897945"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574897945"}]},"ts":"1700574897945"} 2023-11-21 13:54:57,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure be282b8f384cf5531c69d052b9de0fc1, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:54:58,098 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:58,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:58,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing be282b8f384cf5531c69d052b9de0fc1, disabling compactions & flushes 2023-11-21 13:54:58,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:58,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:58,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. after waiting 0 ms 2023-11-21 13:54:58,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:58,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-21 13:54:58,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:58,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:58,106 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(3510): Not adding moved region record: be282b8f384cf5531c69d052b9de0fc1 to self. 2023-11-21 13:54:58,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:58,107 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=be282b8f384cf5531c69d052b9de0fc1, regionState=CLOSED 2023-11-21 13:54:58,107 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700574898107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574898107"}]},"ts":"1700574898107"} 2023-11-21 13:54:58,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=62, resume processing ppid=61 2023-11-21 13:54:58,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure be282b8f384cf5531c69d052b9de0fc1, server=jenkins-hbase6.apache.org,46365,1700574804408 in 161 msec 2023-11-21 13:54:58,110 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=be282b8f384cf5531c69d052b9de0fc1, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=true 2023-11-21 13:54:58,261 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=be282b8f384cf5531c69d052b9de0fc1, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:58,261 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700574898261"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574898261"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574898261"}]},"ts":"1700574898261"} 2023-11-21 13:54:58,262 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure be282b8f384cf5531c69d052b9de0fc1, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:54:58,414 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:58,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:58,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => be282b8f384cf5531c69d052b9de0fc1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.', STARTKEY => '', ENDKEY => ''} 2023-11-21 13:54:58,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:58,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:54:58,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:58,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:58,418 INFO [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:58,419 DEBUG [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1 2023-11-21 13:54:58,419 DEBUG [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1 2023-11-21 13:54:58,420 INFO [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be282b8f384cf5531c69d052b9de0fc1 columnFamilyName family1 2023-11-21 13:54:58,424 DEBUG [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/2c8c59a3cf3e4773a0b247c55a12a300 2023-11-21 13:54:58,428 DEBUG [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/a806c0a00e9243a98913fadaabefe84d_SeqId_46_ 2023-11-21 13:54:58,431 DEBUG [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/c0dbd30e50df41fe8ac0bf65c2e9df9e 2023-11-21 13:54:58,431 INFO [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] regionserver.HStore(310): Store=be282b8f384cf5531c69d052b9de0fc1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:54:58,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:58,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:58,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:58,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened be282b8f384cf5531c69d052b9de0fc1; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73277982, jitterRate=0.09192702174186707}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-21 13:54:58,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:58,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1., pid=63, masterSystemTime=1700574898414 2023-11-21 13:54:58,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:54:58,437 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-21 13:54:58,438 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-21 13:54:58,438 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1912): be282b8f384cf5531c69d052b9de0fc1/family1 is initiating minor compaction (all files) 2023-11-21 13:54:58,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:58,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:58,438 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of be282b8f384cf5531c69d052b9de0fc1/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:58,439 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/c0dbd30e50df41fe8ac0bf65c2e9df9e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/2c8c59a3cf3e4773a0b247c55a12a300, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/a806c0a00e9243a98913fadaabefe84d_SeqId_46_] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp, totalSize=388.1 K 2023-11-21 13:54:58,439 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=be282b8f384cf5531c69d052b9de0fc1, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:58,439 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting c0dbd30e50df41fe8ac0bf65c2e9df9e, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878827509 2023-11-21 13:54:58,439 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700574898439"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574898439"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574898439"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574898439"}]},"ts":"1700574898439"} 2023-11-21 13:54:58,439 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 2c8c59a3cf3e4773a0b247c55a12a300, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621227509 2023-11-21 13:54:58,440 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting a806c0a00e9243a98913fadaabefe84d_SeqId_46_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878827509 2023-11-21 13:54:58,442 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=63, resume processing ppid=61 2023-11-21 13:54:58,442 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure be282b8f384cf5531c69d052b9de0fc1, server=jenkins-hbase6.apache.org,46365,1700574804408 in 178 msec 2023-11-21 13:54:58,443 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=61, resume processing ppid=60 2023-11-21 13:54:58,443 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=be282b8f384cf5531c69d052b9de0fc1, REOPEN/MOVE in 498 msec 2023-11-21 13:54:58,446 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=60, resume processing ppid=59 2023-11-21 13:54:58,446 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 502 msec 2023-11-21 13:54:58,447 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 916 msec 2023-11-21 13:54:58,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-21 13:54:58,449 INFO [Listener at localhost/35077] compactions.TestMobCompactor(278): alter status finished 2023-11-21 13:54:58,450 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43219] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:58,452 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-21 13:54:58,455 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-21 13:54:58,455 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:54:58,455 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700575498455 2023-11-21 13:54:58,456 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-21 13:54:58,456 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-21 13:54:58,456 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-21 13:54:58,458 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] zookeeper.ReadOnlyZKClient(139): Connect 0x7792048e to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:54:58,467 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): be282b8f384cf5531c69d052b9de0fc1#family1#compaction#74 average throughput is 14.97 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-21 13:54:58,469 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63bc2922, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:54:58,469 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:54:58,469 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:54:58,469 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:54:58,469 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:54:58,469 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:54:59,291 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286f15e306a6e74237b755f6d5a9ceb7f8 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511286f15e306a6e74237b755f6d5a9ceb7f8 2023-11-21 13:54:59,292 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-21 13:54:59,304 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:54:59,305 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:36844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:54:59,310 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-21 13:54:59,312 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:52988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-21 13:54:59,320 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/07f20a823bf74adea3d4fe71042eb485 first=Optional[r05] last=Optional[r8] 2023-11-21 13:54:59,321 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=50 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/07f20a823bf74adea3d4fe71042eb485}] 2023-11-21 13:54:59,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/07f20a823bf74adea3d4fe71042eb485 for inclusion in be282b8f384cf5531c69d052b9de0fc1/family1 2023-11-21 13:54:59,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-21 13:54:59,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:54:59,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:59,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/07f20a823bf74adea3d4fe71042eb485 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__demfgaljmjj357rci6kf51th5dnhhdivmfjtnqv27iov2h6td8u5g1uv65ifgap0/family1/07f20a823bf74adea3d4fe71042eb485 2023-11-21 13:54:59,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__demfgaljmjj357rci6kf51th5dnhhdivmfjtnqv27iov2h6td8u5g1uv65ifgap0/family1/07f20a823bf74adea3d4fe71042eb485 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/580ea10746b0499188c095b29448c86f_SeqId_52_ 2023-11-21 13:54:59,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__demfgaljmjj357rci6kf51th5dnhhdivmfjtnqv27iov2h6td8u5g1uv65ifgap0/family1/07f20a823bf74adea3d4fe71042eb485 into be282b8f384cf5531c69d052b9de0fc1/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/580ea10746b0499188c095b29448c86f_SeqId_52_ - updating store file list. 2023-11-21 13:54:59,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/580ea10746b0499188c095b29448c86f_SeqId_52_ into be282b8f384cf5531c69d052b9de0fc1/family1 2023-11-21 13:54:59,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__demfgaljmjj357rci6kf51th5dnhhdivmfjtnqv27iov2h6td8u5g1uv65ifgap0/family1/07f20a823bf74adea3d4fe71042eb485 into be282b8f384cf5531c69d052b9de0fc1/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/580ea10746b0499188c095b29448c86f_SeqId_52_) 2023-11-21 13:54:59,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__demfgaljmjj357rci6kf51th5dnhhdivmfjtnqv27iov2h6td8u5g1uv65ifgap0/family1/07f20a823bf74adea3d4fe71042eb485 2023-11-21 13:54:59,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-21 13:54:59,335 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:59,336 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120e91b373602dc429eb9fb5ad6703c6335 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120e91b373602dc429eb9fb5ad6703c6335 2023-11-21 13:54:59,337 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128f97fdfe74acd4e07a471fbf88f189722 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128f97fdfe74acd4e07a471fbf88f189722 2023-11-21 13:54:59,338 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-21 13:54:59,338 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-21 13:54:59,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:54:59,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:54:59,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:54:59,338 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-21 13:54:59,338 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:54:59,339 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-21 13:54:59,340 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 888 msec 2023-11-21 13:54:59,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$12(2454): Client=jenkins//172.31.2.20 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-21 13:54:59,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:54:59,684 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/.tmp/family1/aa8af80d5e754a148f3170596a5eb634 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/aa8af80d5e754a148f3170596a5eb634 2023-11-21 13:54:59,688 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in be282b8f384cf5531c69d052b9de0fc1/family1 of be282b8f384cf5531c69d052b9de0fc1 into aa8af80d5e754a148f3170596a5eb634(size=192.0 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-21 13:54:59,688 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:59,688 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1., storeName=be282b8f384cf5531c69d052b9de0fc1/family1, priority=13, startTime=1700574898436; duration=1sec 2023-11-21 13:54:59,688 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:54:59,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/c0dbd30e50df41fe8ac0bf65c2e9df9e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/2c8c59a3cf3e4773a0b247c55a12a300, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/a806c0a00e9243a98913fadaabefe84d_SeqId_46_] to archive 2023-11-21 13:54:59,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:54:59,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/c0dbd30e50df41fe8ac0bf65c2e9df9e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/c0dbd30e50df41fe8ac0bf65c2e9df9e 2023-11-21 13:54:59,708 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/2c8c59a3cf3e4773a0b247c55a12a300 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/2c8c59a3cf3e4773a0b247c55a12a300 2023-11-21 13:54:59,709 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/a806c0a00e9243a98913fadaabefe84d_SeqId_46_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/a806c0a00e9243a98913fadaabefe84d_SeqId_46_ 2023-11-21 13:54:59,810 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-21 13:54:59,811 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-21 13:54:59,811 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-21 13:54:59,813 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-21 13:54:59,815 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=be282b8f384cf5531c69d052b9de0fc1, REOPEN/MOVE}] 2023-11-21 13:54:59,815 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=be282b8f384cf5531c69d052b9de0fc1, REOPEN/MOVE 2023-11-21 13:54:59,816 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=be282b8f384cf5531c69d052b9de0fc1, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:59,816 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700574899816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574899816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574899816"}]},"ts":"1700574899816"} 2023-11-21 13:54:59,817 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure be282b8f384cf5531c69d052b9de0fc1, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:54:59,968 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:54:59,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:59,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing be282b8f384cf5531c69d052b9de0fc1, disabling compactions & flushes 2023-11-21 13:54:59,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:59,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:59,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. after waiting 0 ms 2023-11-21 13:54:59,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:59,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-11-21 13:54:59,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:54:59,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:54:59,977 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(3510): Not adding moved region record: be282b8f384cf5531c69d052b9de0fc1 to self. 2023-11-21 13:54:59,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:54:59,978 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=be282b8f384cf5531c69d052b9de0fc1, regionState=CLOSED 2023-11-21 13:54:59,979 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700574899978"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574899978"}]},"ts":"1700574899978"} 2023-11-21 13:54:59,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=68, resume processing ppid=67 2023-11-21 13:54:59,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure be282b8f384cf5531c69d052b9de0fc1, server=jenkins-hbase6.apache.org,46365,1700574804408 in 163 msec 2023-11-21 13:54:59,981 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=be282b8f384cf5531c69d052b9de0fc1, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=true 2023-11-21 13:55:00,131 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=be282b8f384cf5531c69d052b9de0fc1, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:00,132 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700574900131"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574900131"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574900131"}]},"ts":"1700574900131"} 2023-11-21 13:55:00,134 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure be282b8f384cf5531c69d052b9de0fc1, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:00,285 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:00,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:55:00,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => be282b8f384cf5531c69d052b9de0fc1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.', STARTKEY => '', ENDKEY => ''} 2023-11-21 13:55:00,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:55:00,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:00,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:55:00,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:55:00,290 INFO [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:55:00,291 DEBUG [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1 2023-11-21 13:55:00,291 DEBUG [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1 2023-11-21 13:55:00,291 INFO [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be282b8f384cf5531c69d052b9de0fc1 columnFamilyName family1 2023-11-21 13:55:00,299 DEBUG [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/580ea10746b0499188c095b29448c86f_SeqId_52_ 2023-11-21 13:55:00,301 DEBUG [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/family1/aa8af80d5e754a148f3170596a5eb634 2023-11-21 13:55:00,301 INFO [StoreOpener-be282b8f384cf5531c69d052b9de0fc1-1] regionserver.HStore(310): Store=be282b8f384cf5531c69d052b9de0fc1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:00,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:55:00,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:55:00,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:55:00,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened be282b8f384cf5531c69d052b9de0fc1; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69779575, jitterRate=0.03979669511318207}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-21 13:55:00,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:55:00,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1., pid=69, masterSystemTime=1700574900285 2023-11-21 13:55:00,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:55:00,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:55:00,309 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=be282b8f384cf5531c69d052b9de0fc1, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:00,309 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700574900309"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574900309"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574900309"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574900309"}]},"ts":"1700574900309"} 2023-11-21 13:55:00,312 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=69, resume processing ppid=67 2023-11-21 13:55:00,312 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure be282b8f384cf5531c69d052b9de0fc1, server=jenkins-hbase6.apache.org,46365,1700574804408 in 178 msec 2023-11-21 13:55:00,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=67, resume processing ppid=66 2023-11-21 13:55:00,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=be282b8f384cf5531c69d052b9de0fc1, REOPEN/MOVE in 497 msec 2023-11-21 13:55:00,317 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=66, resume processing ppid=65 2023-11-21 13:55:00,317 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 503 msec 2023-11-21 13:55:00,321 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 918 msec 2023-11-21 13:55:00,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-21 13:55:00,323 INFO [Listener at localhost/35077] compactions.TestMobCompactor(278): alter status finished 2023-11-21 13:55:00,324 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43219] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-21 13:55:00,326 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-21 13:55:00,327 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-21 13:55:00,327 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:55:00,327 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700575500327 2023-11-21 13:55:00,328 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-21 13:55:00,329 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-21 13:55:00,329 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-21 13:55:00,331 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] zookeeper.ReadOnlyZKClient(139): Connect 0x4795b5e4 to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:55:00,338 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@de4ebdd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:55:00,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:55:00,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:55:00,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:55:00,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:55:00,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:55:00,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:55:00,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:55:00,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-21 13:55:00,339 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-21 13:55:00,339 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:55:00,340 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-21 13:55:00,342 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 15 msec 2023-11-21 13:55:00,398 INFO [Listener at localhost/35077] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=243 (was 248), OpenFileDescriptor=641 (was 655), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=135 (was 164), ProcessCount=172 (was 172), AvailableMemoryMB=6959 (was 6995) 2023-11-21 13:55:00,410 INFO [Listener at localhost/35077] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=243, OpenFileDescriptor=641, MaxFileDescriptor=60000, SystemLoadAverage=135, ProcessCount=172, AvailableMemoryMB=6959 2023-11-21 13:55:00,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-21 13:55:00,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-21 13:55:00,416 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-21 13:55:00,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-21 13:55:00,416 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-21 13:55:00,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-21 13:55:00,418 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac 2023-11-21 13:55:00,418 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac empty. 2023-11-21 13:55:00,419 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac 2023-11-21 13:55:00,419 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-21 13:55:00,426 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-21 13:55:00,427 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => c27959239e0079689a67557253a9daac, NAME => 'testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:55:00,436 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:00,437 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing c27959239e0079689a67557253a9daac, disabling compactions & flushes 2023-11-21 13:55:00,437 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac. 2023-11-21 13:55:00,437 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac. 2023-11-21 13:55:00,437 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac. after waiting 0 ms 2023-11-21 13:55:00,437 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac. 2023-11-21 13:55:00,437 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac. 2023-11-21 13:55:00,437 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for c27959239e0079689a67557253a9daac: 2023-11-21 13:55:00,439 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-21 13:55:00,440 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700574900440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574900440"}]},"ts":"1700574900440"} 2023-11-21 13:55:00,442 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-21 13:55:00,442 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-21 13:55:00,443 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574900442"}]},"ts":"1700574900442"} 2023-11-21 13:55:00,444 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-21 13:55:00,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=c27959239e0079689a67557253a9daac, ASSIGN}] 2023-11-21 13:55:00,450 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=c27959239e0079689a67557253a9daac, ASSIGN 2023-11-21 13:55:00,451 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=c27959239e0079689a67557253a9daac, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:55:00,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-21 13:55:00,602 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=c27959239e0079689a67557253a9daac, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:00,602 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700574900602"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574900602"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574900602"}]},"ts":"1700574900602"} 2023-11-21 13:55:00,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure c27959239e0079689a67557253a9daac, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:00,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-21 13:55:00,755 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:00,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac. 2023-11-21 13:55:00,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c27959239e0079689a67557253a9daac, NAME => 'testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac.', STARTKEY => '', ENDKEY => ''} 2023-11-21 13:55:00,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-21 13:55:00,913 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-21 13:55:00,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-21 13:55:00,913 INFO [regionserver/jenkins-hbase6:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-21 13:55:00,913 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x490e8a71 to 127.0.0.1:52369 2023-11-21 13:55:00,913 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:55:00,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction c27959239e0079689a67557253a9daac 2023-11-21 13:55:00,913 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-21 13:55:00,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:00,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for c27959239e0079689a67557253a9daac 2023-11-21 13:55:00,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for c27959239e0079689a67557253a9daac 2023-11-21 13:55:00,914 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7792048e to 127.0.0.1:52369 2023-11-21 13:55:00,914 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:55:00,914 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4795b5e4 to 127.0.0.1:52369 2023-11-21 13:55:00,914 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:55:00,917 INFO [StoreOpener-c27959239e0079689a67557253a9daac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c27959239e0079689a67557253a9daac 2023-11-21 13:55:00,918 DEBUG [StoreOpener-c27959239e0079689a67557253a9daac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1 2023-11-21 13:55:00,918 DEBUG [StoreOpener-c27959239e0079689a67557253a9daac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1 2023-11-21 13:55:00,919 INFO [StoreOpener-c27959239e0079689a67557253a9daac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c27959239e0079689a67557253a9daac columnFamilyName f1 2023-11-21 13:55:00,920 INFO [StoreOpener-c27959239e0079689a67557253a9daac-1] regionserver.HStore(310): Store=c27959239e0079689a67557253a9daac/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:00,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac 2023-11-21 13:55:00,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac 2023-11-21 13:55:00,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for c27959239e0079689a67557253a9daac 2023-11-21 13:55:00,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:55:00,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened c27959239e0079689a67557253a9daac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65957761, jitterRate=-0.01715277135372162}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-21 13:55:00,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for c27959239e0079689a67557253a9daac: 2023-11-21 13:55:00,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac., pid=73, masterSystemTime=1700574900755 2023-11-21 13:55:00,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac. 2023-11-21 13:55:00,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac. 2023-11-21 13:55:00,927 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=c27959239e0079689a67557253a9daac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:00,927 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700574900927"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574900927"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574900927"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574900927"}]},"ts":"1700574900927"} 2023-11-21 13:55:00,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=73, resume processing ppid=72 2023-11-21 13:55:00,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure c27959239e0079689a67557253a9daac, server=jenkins-hbase6.apache.org,46365,1700574804408 in 325 msec 2023-11-21 13:55:00,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=72, resume processing ppid=71 2023-11-21 13:55:00,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=c27959239e0079689a67557253a9daac, ASSIGN in 482 msec 2023-11-21 13:55:00,931 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-21 13:55:00,931 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574900931"}]},"ts":"1700574900931"} 2023-11-21 13:55:00,932 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-21 13:55:00,935 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-21 13:55:00,936 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 521 msec 2023-11-21 13:55:01,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-21 13:55:01,020 INFO [Listener at localhost/35077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-21 13:55:01,020 DEBUG [Listener at localhost/35077] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-21 13:55:01,022 INFO [Listener at localhost/35077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-21 13:55:01,026 INFO [Listener at localhost/35077] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-21 13:55:01,027 INFO [Listener at localhost/35077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-21 13:55:01,027 INFO [Listener at localhost/35077] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-21 13:55:01,031 INFO [Listener at localhost/35077] regionserver.HRegion(2745): Flushing c27959239e0079689a67557253a9daac 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-21 13:55:01,445 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311211414d7ebb30a47c2a2fc2f3c54af795b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311211414d7ebb30a47c2a2fc2f3c54af795b 2023-11-21 13:55:01,693 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-21 13:55:01,851 INFO [Listener at localhost/35077] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/.tmp/f1/2242a845c94d48e99d6cc937e025aa82 2023-11-21 13:55:01,856 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/.tmp/f1/2242a845c94d48e99d6cc937e025aa82 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82 2023-11-21 13:55:01,859 INFO [Listener at localhost/35077] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82, entries=1, sequenceid=5, filesize=4.9 K 2023-11-21 13:55:01,860 INFO [Listener at localhost/35077] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for c27959239e0079689a67557253a9daac in 829ms, sequenceid=5, compaction requested=false 2023-11-21 13:55:01,861 DEBUG [Listener at localhost/35077] regionserver.HRegion(2446): Flush status journal for c27959239e0079689a67557253a9daac: 2023-11-21 13:55:01,863 INFO [Listener at localhost/35077] regionserver.HRegion(2745): Flushing c27959239e0079689a67557253a9daac 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-21 13:55:02,274 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231121b24baa9e167f4687901c36e500bcca6a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231121b24baa9e167f4687901c36e500bcca6a 2023-11-21 13:55:02,679 INFO [Listener at localhost/35077] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/.tmp/f1/ebc4ef825fd84537acc09f6b01239ee4 2023-11-21 13:55:02,684 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/.tmp/f1/ebc4ef825fd84537acc09f6b01239ee4 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4 2023-11-21 13:55:02,687 INFO [Listener at localhost/35077] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4, entries=1, sequenceid=9, filesize=4.9 K 2023-11-21 13:55:02,688 INFO [Listener at localhost/35077] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for c27959239e0079689a67557253a9daac in 825ms, sequenceid=9, compaction requested=false 2023-11-21 13:55:02,688 DEBUG [Listener at localhost/35077] regionserver.HRegion(2446): Flush status journal for c27959239e0079689a67557253a9daac: 2023-11-21 13:55:02,690 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43219] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-21 13:55:02,691 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-21 13:55:02,692 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-21 13:55:02,692 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:55:02,692 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700575502692 2023-11-21 13:55:02,693 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-21 13:55:02,693 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-21 13:55:02,693 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-21 13:55:02,695 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] zookeeper.ReadOnlyZKClient(139): Connect 0x5b793056 to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:55:02,700 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@716982e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:55:02,700 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231121 for table='testGetAfterCompaction' and column='f1' 2023-11-21 13:55:02,742 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:02,742 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:02,793 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:02,793 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:02,844 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:02,844 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:02,895 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:02,895 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:02,946 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:02,946 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:02,997 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:02,997 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,048 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,048 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,099 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,099 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,127 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231121e5f659a8a4be4e9ca401644f95306084 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231121e5f659a8a4be4e9ca401644f95306084 2023-11-21 13:55:03,128 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231121 table='testGetAfterCompaction' column='f1' 2023-11-21 13:55:03,142 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:55:03,144 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:43774, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:55:03,149 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,149 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,150 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-21 13:55:03,152 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:33960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-21 13:55:03,161 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231121/f1/1c877ca0bbad41e78da9ea040a963546 first=Optional[r1] last=Optional[r2] 2023-11-21 13:55:03,161 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{f1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231121/f1/1c877ca0bbad41e78da9ea040a963546}] 2023-11-21 13:55:03,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231121/f1/1c877ca0bbad41e78da9ea040a963546 for inclusion in c27959239e0079689a67557253a9daac/f1 2023-11-21 13:55:03,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-21 13:55:03,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:55:03,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for c27959239e0079689a67557253a9daac: 2023-11-21 13:55:03,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231121/f1/1c877ca0bbad41e78da9ea040a963546 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testGetAfterCompaction__scorhhdm2s4h7kruhd6plphdjvv7c5p3hlbphsl8d8q4o5as989f3n59bo9alibs/f1/1c877ca0bbad41e78da9ea040a963546 2023-11-21 13:55:03,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testGetAfterCompaction__scorhhdm2s4h7kruhd6plphdjvv7c5p3hlbphsl8d8q4o5as989f3n59bo9alibs/f1/1c877ca0bbad41e78da9ea040a963546 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_ 2023-11-21 13:55:03,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testGetAfterCompaction__scorhhdm2s4h7kruhd6plphdjvv7c5p3hlbphsl8d8q4o5as989f3n59bo9alibs/f1/1c877ca0bbad41e78da9ea040a963546 into c27959239e0079689a67557253a9daac/f1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_ - updating store file list. 2023-11-21 13:55:03,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_ into c27959239e0079689a67557253a9daac/f1 2023-11-21 13:55:03,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testGetAfterCompaction__scorhhdm2s4h7kruhd6plphdjvv7c5p3hlbphsl8d8q4o5as989f3n59bo9alibs/f1/1c877ca0bbad41e78da9ea040a963546 into c27959239e0079689a67557253a9daac/f1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_) 2023-11-21 13:55:03,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testGetAfterCompaction__scorhhdm2s4h7kruhd6plphdjvv7c5p3hlbphsl8d8q4o5as989f3n59bo9alibs/f1/1c877ca0bbad41e78da9ea040a963546 2023-11-21 13:55:03,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(1912): c27959239e0079689a67557253a9daac/f1 is initiating minor compaction 2023-11-21 13:55:03,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@64d996f4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:55:03,176 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c27959239e0079689a67557253a9daac/f1 in testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac. 2023-11-21 13:55:03,176 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/.tmp, totalSize=10.0 K 2023-11-21 13:55:03,176 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting ebc4ef825fd84537acc09f6b01239ee4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-21 13:55:03,176 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 95216d28179544c7ae5077ffa497c734_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-21 13:55:03,178 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231121 table='testGetAfterCompaction' column='f1' 2023-11-21 13:55:03,179 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:03,181 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311211414d7ebb30a47c2a2fc2f3c54af795b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311211414d7ebb30a47c2a2fc2f3c54af795b 2023-11-21 13:55:03,182 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231121b24baa9e167f4687901c36e500bcca6a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231121b24baa9e167f4687901c36e500bcca6a 2023-11-21 13:55:03,182 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-21 13:55:03,182 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231121' 2023-11-21 13:55:03,183 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231121 for table='testGetAfterCompaction' and column='f1' 2023-11-21 13:55:03,183 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-21 13:55:03,183 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:55:03,184 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-21 13:55:03,185 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): c27959239e0079689a67557253a9daac#f1#compaction#77 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-21 13:55:03,185 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 494 msec 2023-11-21 13:55:03,200 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,200 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700574903123; access_time=1700574902714; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-21 13:55:03,200 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,204 DEBUG [Listener at localhost/35077] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-21 13:55:03,207 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:43780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-21 13:55:03,207 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46365] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac. 2023-11-21 13:55:03,208 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46365] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-21 13:55:03,208 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-21 13:55:03,208 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46365] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-21 13:55:03,208 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46365] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac. because compaction request was cancelled 2023-11-21 13:55:03,260 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,260 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700574903123; access_time=1700574902714; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-21 13:55:03,260 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,311 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,311 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700574903123; access_time=1700574902714; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-21 13:55:03,311 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,362 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,362 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700574903123; access_time=1700574902714; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-21 13:55:03,362 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,413 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,413 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700574903123; access_time=1700574902714; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-21 13:55:03,413 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,464 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,464 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700574903123; access_time=1700574902714; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-21 13:55:03,464 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,515 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,515 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700574903123; access_time=1700574902714; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-21 13:55:03,515 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,566 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,566 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700574903123; access_time=1700574902714; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-21 13:55:03,566 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,616 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,617 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700574903123; access_time=1700574902714; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-21 13:55:03,617 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,641 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-21 13:55:03,667 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,668 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700574903123; access_time=1700574902714; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-21 13:55:03,668 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,679 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-21 13:55:03,679 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-11-21 13:55:03,719 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,719 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700574903123; access_time=1700574902714; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-21 13:55:03,719 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,769 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,770 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700574903123; access_time=1700574902714; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-21 13:55:03,770 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,821 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,821 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700574903123; access_time=1700574902714; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-21 13:55:03,821 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,871 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,872 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700574903123; access_time=1700574902714; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-21 13:55:03,872 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,922 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,923 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700574903123; access_time=1700574902714; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-21 13:55:03,923 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,973 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:03,973 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700574903123; access_time=1700574902714; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-21 13:55:03,974 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574902679; access_time=1700574901864; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:04,002 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/.tmp/f1/65b89ff1cfe448d598f8a0594a309e1a as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/65b89ff1cfe448d598f8a0594a309e1a 2023-11-21 13:55:04,006 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in c27959239e0079689a67557253a9daac/f1 of c27959239e0079689a67557253a9daac into 65b89ff1cfe448d598f8a0594a309e1a(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:55:04,006 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c27959239e0079689a67557253a9daac: 2023-11-21 13:55:04,007 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1700574903176; duration=0sec 2023-11-21 13:55:04,007 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:55:04,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_] to archive 2023-11-21 13:55:04,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:04,016 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/ebc4ef825fd84537acc09f6b01239ee4 2023-11-21 13:55:04,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/95216d28179544c7ae5077ffa497c734_SeqId_12_ 2023-11-21 13:55:04,024 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700574901850; access_time=1700574901034; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:04,024 INFO [Listener at localhost/35077] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/65b89ff1cfe448d598f8a0594a309e1a; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1700574903997; access_time=1700574903181; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-21 13:55:04,143 INFO [Listener at localhost/35077] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-21 13:55:04,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$11(2418): Client=jenkins//172.31.2.20 disable testGetAfterCompaction 2023-11-21 13:55:04,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-21 13:55:04,157 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574904156"}]},"ts":"1700574904156"} 2023-11-21 13:55:04,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-21 13:55:04,158 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-21 13:55:04,160 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-21 13:55:04,161 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=c27959239e0079689a67557253a9daac, UNASSIGN}] 2023-11-21 13:55:04,162 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=c27959239e0079689a67557253a9daac, UNASSIGN 2023-11-21 13:55:04,163 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=c27959239e0079689a67557253a9daac, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:04,163 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700574904163"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574904163"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574904163"}]},"ts":"1700574904163"} 2023-11-21 13:55:04,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure c27959239e0079689a67557253a9daac, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:04,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-21 13:55:04,315 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:04,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close c27959239e0079689a67557253a9daac 2023-11-21 13:55:04,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing c27959239e0079689a67557253a9daac, disabling compactions & flushes 2023-11-21 13:55:04,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac. 2023-11-21 13:55:04,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac. 2023-11-21 13:55:04,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac. after waiting 0 ms 2023-11-21 13:55:04,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac. 2023-11-21 13:55:04,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-21 13:55:04,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-21 13:55:04,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac. 2023-11-21 13:55:04,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for c27959239e0079689a67557253a9daac: 2023-11-21 13:55:04,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed c27959239e0079689a67557253a9daac 2023-11-21 13:55:04,323 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=c27959239e0079689a67557253a9daac, regionState=CLOSED 2023-11-21 13:55:04,324 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700574904323"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574904323"}]},"ts":"1700574904323"} 2023-11-21 13:55:04,326 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=77, resume processing ppid=76 2023-11-21 13:55:04,326 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure c27959239e0079689a67557253a9daac, server=jenkins-hbase6.apache.org,46365,1700574804408 in 161 msec 2023-11-21 13:55:04,327 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=76, resume processing ppid=75 2023-11-21 13:55:04,327 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=c27959239e0079689a67557253a9daac, UNASSIGN in 165 msec 2023-11-21 13:55:04,328 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574904328"}]},"ts":"1700574904328"} 2023-11-21 13:55:04,329 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-21 13:55:04,330 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-21 13:55:04,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 182 msec 2023-11-21 13:55:04,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-21 13:55:04,460 INFO [Listener at localhost/35077] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-21 13:55:04,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$5(2228): Client=jenkins//172.31.2.20 delete testGetAfterCompaction 2023-11-21 13:55:04,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-21 13:55:04,474 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-21 13:55:04,475 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-21 13:55:04,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-21 13:55:04,482 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac 2023-11-21 13:55:04,489 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1, FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/recovered.edits] 2023-11-21 13:55:04,494 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/2242a845c94d48e99d6cc937e025aa82 2023-11-21 13:55:04,496 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/65b89ff1cfe448d598f8a0594a309e1a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/f1/65b89ff1cfe448d598f8a0594a309e1a 2023-11-21 13:55:04,499 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/recovered.edits/15.seqid to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac/recovered.edits/15.seqid 2023-11-21 13:55:04,500 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testGetAfterCompaction/c27959239e0079689a67557253a9daac 2023-11-21 13:55:04,500 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-21 13:55:04,500 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-21 13:55:04,501 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-21 13:55:04,505 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231121e5f659a8a4be4e9ca401644f95306084 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231121e5f659a8a4be4e9ca401644f95306084 2023-11-21 13:55:04,505 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-21 13:55:04,508 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-21 13:55:04,544 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-21 13:55:04,549 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-21 13:55:04,550 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-21 13:55:04,550 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-21 13:55:04,550 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700574904550"}]},"ts":"9223372036854775807"} 2023-11-21 13:55:04,552 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-21 13:55:04,552 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c27959239e0079689a67557253a9daac, NAME => 'testGetAfterCompaction,,1700574900413.c27959239e0079689a67557253a9daac.', STARTKEY => '', ENDKEY => ''}] 2023-11-21 13:55:04,552 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-21 13:55:04,552 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1700574904552"}]},"ts":"9223372036854775807"} 2023-11-21 13:55:04,554 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-21 13:55:04,557 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-21 13:55:04,558 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 91 msec 2023-11-21 13:55:04,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-21 13:55:04,578 INFO [Listener at localhost/35077] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-21 13:55:04,591 INFO [Listener at localhost/35077] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=239 (was 243), OpenFileDescriptor=625 (was 641), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=135 (was 135), ProcessCount=172 (was 172), AvailableMemoryMB=6910 (was 6959) 2023-11-21 13:55:04,602 INFO [Listener at localhost/35077] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=239, OpenFileDescriptor=625, MaxFileDescriptor=60000, SystemLoadAverage=135, ProcessCount=172, AvailableMemoryMB=6910 2023-11-21 13:55:04,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-21 13:55:04,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-21 13:55:04,606 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-21 13:55:04,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-21 13:55:04,606 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-21 13:55:04,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-21 13:55:04,608 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e 2023-11-21 13:55:04,608 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:04,608 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:04,609 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e empty. 2023-11-21 13:55:04,609 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575 empty. 2023-11-21 13:55:04,609 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7 empty. 2023-11-21 13:55:04,609 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e 2023-11-21 13:55:04,609 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:04,609 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:04,610 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-21 13:55:04,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-21 13:55:04,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-21 13:55:05,017 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-21 13:55:05,019 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2c2220da91c79539696a8094984e331e, NAME => 'testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:55:05,019 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => a3726db2a6d35a4ace20911e14a84575, NAME => 'testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:55:05,019 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 489c1aeed0cfc5efd1e74cd4f52c14b7, NAME => 'testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:55:05,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-21 13:55:05,433 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:05,433 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:05,433 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 2c2220da91c79539696a8094984e331e, disabling compactions & flushes 2023-11-21 13:55:05,433 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 489c1aeed0cfc5efd1e74cd4f52c14b7, disabling compactions & flushes 2023-11-21 13:55:05,433 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:05,433 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:05,433 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:05,433 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. after waiting 0 ms 2023-11-21 13:55:05,433 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:05,433 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:05,434 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:05,434 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. after waiting 0 ms 2023-11-21 13:55:05,434 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 2c2220da91c79539696a8094984e331e: 2023-11-21 13:55:05,434 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:05,434 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:05,434 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:05,434 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing a3726db2a6d35a4ace20911e14a84575, disabling compactions & flushes 2023-11-21 13:55:05,434 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 489c1aeed0cfc5efd1e74cd4f52c14b7: 2023-11-21 13:55:05,434 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:05,434 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:05,434 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. after waiting 0 ms 2023-11-21 13:55:05,434 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:05,434 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:05,434 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for a3726db2a6d35a4ace20911e14a84575: 2023-11-21 13:55:05,436 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-21 13:55:05,437 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700574905436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574905436"}]},"ts":"1700574905436"} 2023-11-21 13:55:05,437 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700574905436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574905436"}]},"ts":"1700574905436"} 2023-11-21 13:55:05,437 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700574905436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574905436"}]},"ts":"1700574905436"} 2023-11-21 13:55:05,438 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-21 13:55:05,439 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-21 13:55:05,439 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574905439"}]},"ts":"1700574905439"} 2023-11-21 13:55:05,440 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-21 13:55:05,444 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2c2220da91c79539696a8094984e331e, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=489c1aeed0cfc5efd1e74cd4f52c14b7, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a3726db2a6d35a4ace20911e14a84575, ASSIGN}] 2023-11-21 13:55:05,445 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2c2220da91c79539696a8094984e331e, ASSIGN 2023-11-21 13:55:05,446 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a3726db2a6d35a4ace20911e14a84575, ASSIGN 2023-11-21 13:55:05,446 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=489c1aeed0cfc5efd1e74cd4f52c14b7, ASSIGN 2023-11-21 13:55:05,447 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2c2220da91c79539696a8094984e331e, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:55:05,447 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=489c1aeed0cfc5efd1e74cd4f52c14b7, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:55:05,447 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a3726db2a6d35a4ace20911e14a84575, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:55:05,598 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=2c2220da91c79539696a8094984e331e, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:05,598 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=a3726db2a6d35a4ace20911e14a84575, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:05,598 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=489c1aeed0cfc5efd1e74cd4f52c14b7, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:05,599 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700574905598"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574905598"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574905598"}]},"ts":"1700574905598"} 2023-11-21 13:55:05,599 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700574905598"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574905598"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574905598"}]},"ts":"1700574905598"} 2023-11-21 13:55:05,599 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700574905598"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574905598"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574905598"}]},"ts":"1700574905598"} 2023-11-21 13:55:05,600 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure 2c2220da91c79539696a8094984e331e, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:05,601 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure a3726db2a6d35a4ace20911e14a84575, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:05,603 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure 489c1aeed0cfc5efd1e74cd4f52c14b7, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:05,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-21 13:55:05,752 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:05,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:05,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a3726db2a6d35a4ace20911e14a84575, NAME => 'testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575.', STARTKEY => '2', ENDKEY => ''} 2023-11-21 13:55:05,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:05,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:05,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:05,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:05,756 INFO [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:05,757 DEBUG [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1 2023-11-21 13:55:05,757 DEBUG [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1 2023-11-21 13:55:05,758 INFO [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3726db2a6d35a4ace20911e14a84575 columnFamilyName family1 2023-11-21 13:55:05,759 INFO [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] regionserver.HStore(310): Store=a3726db2a6d35a4ace20911e14a84575/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:05,759 INFO [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:05,760 DEBUG [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2 2023-11-21 13:55:05,760 DEBUG [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2 2023-11-21 13:55:05,761 INFO [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3726db2a6d35a4ace20911e14a84575 columnFamilyName family2 2023-11-21 13:55:05,762 INFO [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] regionserver.HStore(310): Store=a3726db2a6d35a4ace20911e14a84575/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:05,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:05,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:05,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-21 13:55:05,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:05,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:55:05,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened a3726db2a6d35a4ace20911e14a84575; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67104313, jitterRate=-6.781518459320068E-5}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-21 13:55:05,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for a3726db2a6d35a4ace20911e14a84575: 2023-11-21 13:55:05,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575., pid=84, masterSystemTime=1700574905752 2023-11-21 13:55:05,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:05,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:05,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:05,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2c2220da91c79539696a8094984e331e, NAME => 'testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e.', STARTKEY => '', ENDKEY => '1'} 2023-11-21 13:55:05,769 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=a3726db2a6d35a4ace20911e14a84575, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:05,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 2c2220da91c79539696a8094984e331e 2023-11-21 13:55:05,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:05,770 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700574905769"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574905769"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574905769"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574905769"}]},"ts":"1700574905769"} 2023-11-21 13:55:05,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 2c2220da91c79539696a8094984e331e 2023-11-21 13:55:05,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 2c2220da91c79539696a8094984e331e 2023-11-21 13:55:05,771 INFO [StoreOpener-2c2220da91c79539696a8094984e331e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2c2220da91c79539696a8094984e331e 2023-11-21 13:55:05,772 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=84, resume processing ppid=82 2023-11-21 13:55:05,772 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure a3726db2a6d35a4ace20911e14a84575, server=jenkins-hbase6.apache.org,46365,1700574804408 in 171 msec 2023-11-21 13:55:05,773 DEBUG [StoreOpener-2c2220da91c79539696a8094984e331e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1 2023-11-21 13:55:05,773 DEBUG [StoreOpener-2c2220da91c79539696a8094984e331e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1 2023-11-21 13:55:05,773 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a3726db2a6d35a4ace20911e14a84575, ASSIGN in 328 msec 2023-11-21 13:55:05,773 INFO [StoreOpener-2c2220da91c79539696a8094984e331e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c2220da91c79539696a8094984e331e columnFamilyName family1 2023-11-21 13:55:05,774 INFO [StoreOpener-2c2220da91c79539696a8094984e331e-1] regionserver.HStore(310): Store=2c2220da91c79539696a8094984e331e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:05,774 INFO [StoreOpener-2c2220da91c79539696a8094984e331e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2c2220da91c79539696a8094984e331e 2023-11-21 13:55:05,775 DEBUG [StoreOpener-2c2220da91c79539696a8094984e331e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2 2023-11-21 13:55:05,775 DEBUG [StoreOpener-2c2220da91c79539696a8094984e331e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2 2023-11-21 13:55:05,775 INFO [StoreOpener-2c2220da91c79539696a8094984e331e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c2220da91c79539696a8094984e331e columnFamilyName family2 2023-11-21 13:55:05,776 INFO [StoreOpener-2c2220da91c79539696a8094984e331e-1] regionserver.HStore(310): Store=2c2220da91c79539696a8094984e331e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:05,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e 2023-11-21 13:55:05,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e 2023-11-21 13:55:05,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-21 13:55:05,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 2c2220da91c79539696a8094984e331e 2023-11-21 13:55:05,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:55:05,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 2c2220da91c79539696a8094984e331e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63048294, jitterRate=-0.06050720810890198}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-21 13:55:05,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 2c2220da91c79539696a8094984e331e: 2023-11-21 13:55:05,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e., pid=83, masterSystemTime=1700574905752 2023-11-21 13:55:05,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:05,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:05,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:05,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 489c1aeed0cfc5efd1e74cd4f52c14b7, NAME => 'testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7.', STARTKEY => '1', ENDKEY => '2'} 2023-11-21 13:55:05,783 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=2c2220da91c79539696a8094984e331e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:05,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:05,783 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700574905783"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574905783"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574905783"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574905783"}]},"ts":"1700574905783"} 2023-11-21 13:55:05,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:05,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:05,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:05,784 INFO [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:05,785 DEBUG [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1 2023-11-21 13:55:05,785 DEBUG [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1 2023-11-21 13:55:05,785 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=83, resume processing ppid=80 2023-11-21 13:55:05,785 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure 2c2220da91c79539696a8094984e331e, server=jenkins-hbase6.apache.org,46365,1700574804408 in 184 msec 2023-11-21 13:55:05,786 INFO [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 489c1aeed0cfc5efd1e74cd4f52c14b7 columnFamilyName family1 2023-11-21 13:55:05,786 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2c2220da91c79539696a8094984e331e, ASSIGN in 342 msec 2023-11-21 13:55:05,786 INFO [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] regionserver.HStore(310): Store=489c1aeed0cfc5efd1e74cd4f52c14b7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:05,787 INFO [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:05,788 DEBUG [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2 2023-11-21 13:55:05,788 DEBUG [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2 2023-11-21 13:55:05,788 INFO [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 489c1aeed0cfc5efd1e74cd4f52c14b7 columnFamilyName family2 2023-11-21 13:55:05,788 INFO [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] regionserver.HStore(310): Store=489c1aeed0cfc5efd1e74cd4f52c14b7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:05,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:05,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:05,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-21 13:55:05,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:05,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:55:05,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 489c1aeed0cfc5efd1e74cd4f52c14b7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63613637, jitterRate=-0.05208294093608856}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-21 13:55:05,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 489c1aeed0cfc5efd1e74cd4f52c14b7: 2023-11-21 13:55:05,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7., pid=85, masterSystemTime=1700574905752 2023-11-21 13:55:05,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:05,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:05,795 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=489c1aeed0cfc5efd1e74cd4f52c14b7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:05,795 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700574905795"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574905795"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574905795"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574905795"}]},"ts":"1700574905795"} 2023-11-21 13:55:05,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=85, resume processing ppid=81 2023-11-21 13:55:05,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure 489c1aeed0cfc5efd1e74cd4f52c14b7, server=jenkins-hbase6.apache.org,46365,1700574804408 in 196 msec 2023-11-21 13:55:05,799 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=81, resume processing ppid=79 2023-11-21 13:55:05,799 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=489c1aeed0cfc5efd1e74cd4f52c14b7, ASSIGN in 355 msec 2023-11-21 13:55:05,799 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-21 13:55:05,799 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574905799"}]},"ts":"1700574905799"} 2023-11-21 13:55:05,800 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-21 13:55:05,802 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-21 13:55:05,803 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.1980 sec 2023-11-21 13:55:06,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-21 13:55:06,712 INFO [Listener at localhost/35077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-21 13:55:06,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:06,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:06,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:06,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:06,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-21 13:55:06,725 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-21 13:55:06,726 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:06,726 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-21 13:55:06,726 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-21 13:55:06,726 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:06,726 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:06,729 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:06,729 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:06,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:06,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:06,729 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:06,729 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:06,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:06,730 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:06,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:06,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:06,730 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-21 13:55:06,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-21 13:55:06,730 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-21 13:55:06,731 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:06,731 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-21 13:55:06,731 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:06,731 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. started... 2023-11-21 13:55:06,731 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:06,731 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. started... 2023-11-21 13:55:06,731 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-21 13:55:06,732 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 489c1aeed0cfc5efd1e74cd4f52c14b7 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-21 13:55:06,732 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:06,732 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. started... 2023-11-21 13:55:06,732 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:06,733 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2c2220da91c79539696a8094984e331e 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-21 13:55:06,732 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a3726db2a6d35a4ace20911e14a84575 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-21 13:55:07,154 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311219416ad37fc114e388efa2d0add8e46e8 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311219416ad37fc114e388efa2d0add8e46e8 2023-11-21 13:55:07,155 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231121b2f42049d02a4b37a43e96962c985b9e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121b2f42049d02a4b37a43e96962c985b9e 2023-11-21 13:55:07,155 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231121d370efe300e447308cc51bb4e12ae2ab to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121d370efe300e447308cc51bb4e12ae2ab 2023-11-21 13:55:07,168 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family1/06b3d411f57145f99e7bb0ad83ecbcb8 2023-11-21 13:55:07,561 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family1/625ff5eabac64bcd9f0e5ba027931c53 2023-11-21 13:55:07,564 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family1/2d7339555d73468f8a547deac0e4da1f 2023-11-21 13:55:07,583 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231121dc2b6625d69342f58bc7d49093db58b1 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231121dc2b6625d69342f58bc7d49093db58b1 2023-11-21 13:55:07,583 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311213096bec9232e4605b68cfba4e678a0ee to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311213096bec9232e4605b68cfba4e678a0ee 2023-11-21 13:55:07,694 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-21 13:55:07,986 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231121d136640b5a6b41af9d5de66c82e37e14 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121d136640b5a6b41af9d5de66c82e37e14 2023-11-21 13:55:07,987 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family2/7cacaaa69f874133add2611b3499950e 2023-11-21 13:55:07,987 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family2/7669c129d1c947e2b93c80da48fe282d 2023-11-21 13:55:07,992 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family1/06b3d411f57145f99e7bb0ad83ecbcb8 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/06b3d411f57145f99e7bb0ad83ecbcb8 2023-11-21 13:55:07,992 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family1/625ff5eabac64bcd9f0e5ba027931c53 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/625ff5eabac64bcd9f0e5ba027931c53 2023-11-21 13:55:07,996 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/625ff5eabac64bcd9f0e5ba027931c53, entries=4, sequenceid=5, filesize=5.4 K 2023-11-21 13:55:07,996 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/06b3d411f57145f99e7bb0ad83ecbcb8, entries=4, sequenceid=5, filesize=5.4 K 2023-11-21 13:55:07,997 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family2/7669c129d1c947e2b93c80da48fe282d as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/7669c129d1c947e2b93c80da48fe282d 2023-11-21 13:55:07,997 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family2/7cacaaa69f874133add2611b3499950e as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/7cacaaa69f874133add2611b3499950e 2023-11-21 13:55:08,000 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/7669c129d1c947e2b93c80da48fe282d, entries=2, sequenceid=5, filesize=5.1 K 2023-11-21 13:55:08,001 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/7cacaaa69f874133add2611b3499950e, entries=2, sequenceid=5, filesize=5.1 K 2023-11-21 13:55:08,001 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 2c2220da91c79539696a8094984e331e in 1268ms, sequenceid=5, compaction requested=false 2023-11-21 13:55:08,001 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2c2220da91c79539696a8094984e331e: 2023-11-21 13:55:08,001 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:08,002 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-21 13:55:08,002 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a3726db2a6d35a4ace20911e14a84575 in 1270ms, sequenceid=5, compaction requested=false 2023-11-21 13:55:08,002 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a3726db2a6d35a4ace20911e14a84575: 2023-11-21 13:55:08,002 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:08,002 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-21 13:55:08,393 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family2/2813c6537fff4fc5970e0d660f5a3b9a 2023-11-21 13:55:08,397 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family1/2d7339555d73468f8a547deac0e4da1f as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/2d7339555d73468f8a547deac0e4da1f 2023-11-21 13:55:08,400 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/2d7339555d73468f8a547deac0e4da1f, entries=4, sequenceid=5, filesize=5.4 K 2023-11-21 13:55:08,401 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family2/2813c6537fff4fc5970e0d660f5a3b9a as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/2813c6537fff4fc5970e0d660f5a3b9a 2023-11-21 13:55:08,404 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/2813c6537fff4fc5970e0d660f5a3b9a, entries=2, sequenceid=5, filesize=5.1 K 2023-11-21 13:55:08,405 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 489c1aeed0cfc5efd1e74cd4f52c14b7 in 1673ms, sequenceid=5, compaction requested=false 2023-11-21 13:55:08,405 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 489c1aeed0cfc5efd1e74cd4f52c14b7: 2023-11-21 13:55:08,405 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:08,405 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-21 13:55:08,405 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-21 13:55:08,406 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:08,406 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-21 13:55:08,406 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-21 13:55:08,407 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:08,407 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:08,407 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:08,408 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:08,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:08,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:08,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:08,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:08,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:08,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-21 13:55:08,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50877070[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:08,409 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-21 13:55:08,409 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:08,410 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:08,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:08,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:08,410 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-21 13:55:08,410 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-21 13:55:08,410 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:08,410 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:08,410 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:08,412 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-21 13:55:08,412 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:08,412 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:08,412 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-21 13:55:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:08,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:08,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-21 13:55:08,415 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-21 13:55:08,415 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:08,415 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:08,415 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-21 13:55:08,415 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:08,416 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:08,416 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:08,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:08,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:08,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:08,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:08,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:08,416 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:08,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:08,417 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:08,418 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:08,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:08,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:08,420 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:08,420 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:08,420 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:08,420 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:08,420 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:08,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-21 13:55:08,420 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:08,420 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:08,420 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:08,421 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:08,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:08,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:08,420 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:08,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:08,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:08,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:08,421 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:08,421 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:08,521 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:08,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:08,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:08,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:08,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:08,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:08,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:08,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-21 13:55:08,530 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-21 13:55:08,531 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:08,531 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-21 13:55:08,531 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-21 13:55:08,531 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:08,531 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:08,532 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:08,532 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:08,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:08,533 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:08,533 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:08,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:08,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:08,534 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-21 13:55:08,536 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-21 13:55:08,536 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-21 13:55:08,536 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-21 13:55:08,536 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:08,536 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-21 13:55:08,536 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:08,537 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. started... 2023-11-21 13:55:08,537 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 489c1aeed0cfc5efd1e74cd4f52c14b7 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-21 13:55:08,537 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:08,537 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. started... 2023-11-21 13:55:08,537 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:08,537 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-21 13:55:08,537 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a3726db2a6d35a4ace20911e14a84575 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-21 13:55:08,537 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:08,537 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. started... 2023-11-21 13:55:08,537 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2c2220da91c79539696a8094984e331e 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-21 13:55:08,555 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231121fdc3a9147e0b46dc9d057989571b4a9a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121fdc3a9147e0b46dc9d057989571b4a9a 2023-11-21 13:55:08,955 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231121481ced72e8634a0e8e51921117a1da00 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121481ced72e8634a0e8e51921117a1da00 2023-11-21 13:55:08,955 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311210fa8109b150d464882a6f44b66b5d449 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311210fa8109b150d464882a6f44b66b5d449 2023-11-21 13:55:08,962 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family1/5ac3b165f9eb4dcf896fc3fc1071be28 2023-11-21 13:55:08,964 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family1/cd9a918c980747cb955ab2f73dee69a6 2023-11-21 13:55:08,976 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311216923139c965840299e665c44b6cb98c9 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311216923139c965840299e665c44b6cb98c9 2023-11-21 13:55:08,976 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231121766edc502d624c0bade967778f48e606 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231121766edc502d624c0bade967778f48e606 2023-11-21 13:55:09,360 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family1/833631d8fbac4f798e75e0acd31d627d 2023-11-21 13:55:09,384 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family2/5502cef6742140928005a8fc6f731c04 2023-11-21 13:55:09,385 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family2/9cefbb6708ea467c83688fd844c68bb7 2023-11-21 13:55:09,388 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family1/5ac3b165f9eb4dcf896fc3fc1071be28 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/5ac3b165f9eb4dcf896fc3fc1071be28 2023-11-21 13:55:09,389 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family1/cd9a918c980747cb955ab2f73dee69a6 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cd9a918c980747cb955ab2f73dee69a6 2023-11-21 13:55:09,392 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/5ac3b165f9eb4dcf896fc3fc1071be28, entries=4, sequenceid=9, filesize=5.4 K 2023-11-21 13:55:09,392 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cd9a918c980747cb955ab2f73dee69a6, entries=4, sequenceid=9, filesize=5.4 K 2023-11-21 13:55:09,393 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family2/5502cef6742140928005a8fc6f731c04 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/5502cef6742140928005a8fc6f731c04 2023-11-21 13:55:09,393 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family2/9cefbb6708ea467c83688fd844c68bb7 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/9cefbb6708ea467c83688fd844c68bb7 2023-11-21 13:55:09,397 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/9cefbb6708ea467c83688fd844c68bb7, entries=2, sequenceid=9, filesize=5.1 K 2023-11-21 13:55:09,397 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/5502cef6742140928005a8fc6f731c04, entries=2, sequenceid=9, filesize=5.1 K 2023-11-21 13:55:09,397 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 489c1aeed0cfc5efd1e74cd4f52c14b7 in 860ms, sequenceid=9, compaction requested=false 2023-11-21 13:55:09,397 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 2c2220da91c79539696a8094984e331e in 860ms, sequenceid=9, compaction requested=false 2023-11-21 13:55:09,397 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 489c1aeed0cfc5efd1e74cd4f52c14b7: 2023-11-21 13:55:09,397 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2c2220da91c79539696a8094984e331e: 2023-11-21 13:55:09,397 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:09,398 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:09,398 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-21 13:55:09,398 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-21 13:55:09,775 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231121e1bd2d3eb39d4852ae82bc3d046cef8a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231121e1bd2d3eb39d4852ae82bc3d046cef8a 2023-11-21 13:55:09,779 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family2/fe584384e451421e966c64b193ca6784 2023-11-21 13:55:09,784 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family1/833631d8fbac4f798e75e0acd31d627d as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/833631d8fbac4f798e75e0acd31d627d 2023-11-21 13:55:09,788 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/833631d8fbac4f798e75e0acd31d627d, entries=4, sequenceid=9, filesize=5.4 K 2023-11-21 13:55:09,788 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family2/fe584384e451421e966c64b193ca6784 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/fe584384e451421e966c64b193ca6784 2023-11-21 13:55:09,792 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/fe584384e451421e966c64b193ca6784, entries=2, sequenceid=9, filesize=5.1 K 2023-11-21 13:55:09,793 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a3726db2a6d35a4ace20911e14a84575 in 1256ms, sequenceid=9, compaction requested=false 2023-11-21 13:55:09,793 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a3726db2a6d35a4ace20911e14a84575: 2023-11-21 13:55:09,793 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:09,793 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-21 13:55:09,793 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-21 13:55:09,793 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:09,793 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-21 13:55:09,793 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-21 13:55:09,797 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:09,797 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:09,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:09,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:09,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:09,797 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:09,798 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:09,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:09,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:09,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:09,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:09,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:09,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-21 13:55:09,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50d541a8[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:09,799 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-21 13:55:09,799 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:09,801 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:09,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:09,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:09,801 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-21 13:55:09,801 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-21 13:55:09,801 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:09,801 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:09,801 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:09,804 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-21 13:55:09,804 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:09,804 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:09,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:09,804 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-21 13:55:09,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:09,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:09,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:09,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:09,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:09,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:09,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:09,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:09,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:09,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:09,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-21 13:55:09,806 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-21 13:55:09,807 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:09,807 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:09,807 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-21 13:55:09,807 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:09,808 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:09,808 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:09,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:09,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:09,808 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:09,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:09,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:09,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:09,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:09,809 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:09,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:09,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:09,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:09,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:09,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:09,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:09,810 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:09,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:09,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:09,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:09,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:09,813 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:09,813 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:09,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:09,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:09,813 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:09,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-21 13:55:09,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:09,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:09,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-21 13:55:09,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:09,814 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:09,814 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:09,820 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:09,820 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:09,820 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:09,820 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:09,820 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:09,820 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:09,820 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:09,823 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-21 13:55:09,914 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:09,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:09,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:09,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:09,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:09,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:09,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:09,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-21 13:55:09,921 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-21 13:55:09,921 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:09,921 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-21 13:55:09,921 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-21 13:55:09,921 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:09,921 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:09,923 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:09,923 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:09,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:09,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:09,923 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:09,923 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:09,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:09,924 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:09,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:09,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:09,924 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-21 13:55:09,925 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-21 13:55:09,925 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-21 13:55:09,925 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-21 13:55:09,925 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:09,925 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-21 13:55:09,926 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:09,926 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. started... 2023-11-21 13:55:09,926 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:09,927 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 489c1aeed0cfc5efd1e74cd4f52c14b7 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-21 13:55:09,927 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. started... 2023-11-21 13:55:09,927 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a3726db2a6d35a4ace20911e14a84575 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-21 13:55:09,928 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-21 13:55:09,928 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:09,928 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:09,928 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. started... 2023-11-21 13:55:09,928 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2c2220da91c79539696a8094984e331e 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-21 13:55:10,348 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231121ec7e5d4ccdd649ea9c5552974861856b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231121ec7e5d4ccdd649ea9c5552974861856b 2023-11-21 13:55:10,348 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231121f8a34cc10a484ecba803bde3af1ea1bf to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121f8a34cc10a484ecba803bde3af1ea1bf 2023-11-21 13:55:10,348 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231121477c593f302a4ebb8e41d1f4bc2d3465 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121477c593f302a4ebb8e41d1f4bc2d3465 2023-11-21 13:55:10,757 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family1/8c0ab801c71b4268811d600415bb2ac7 2023-11-21 13:55:10,758 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family1/08c9168407a946debf88df93938065a2 2023-11-21 13:55:10,758 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family1/5d43ef103d274dc3a9bb93309c6608d8 2023-11-21 13:55:10,774 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231121cb012e713e4e4ab292ed072251cea2db to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121cb012e713e4e4ab292ed072251cea2db 2023-11-21 13:55:10,777 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311218fed1aa0338342c0a4afa0b9e0a9556e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311218fed1aa0338342c0a4afa0b9e0a9556e 2023-11-21 13:55:11,175 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231121913e3e229c234fee9459e2d35af96173 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231121913e3e229c234fee9459e2d35af96173 2023-11-21 13:55:11,178 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family2/7b31f03ff7ab433fb4c5ea94135b0d63 2023-11-21 13:55:11,181 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family2/8a0bfb9aaea443ce937260a1c1b4218b 2023-11-21 13:55:11,183 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family1/5d43ef103d274dc3a9bb93309c6608d8 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/5d43ef103d274dc3a9bb93309c6608d8 2023-11-21 13:55:11,186 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family1/08c9168407a946debf88df93938065a2 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/08c9168407a946debf88df93938065a2 2023-11-21 13:55:11,186 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/5d43ef103d274dc3a9bb93309c6608d8, entries=4, sequenceid=13, filesize=5.4 K 2023-11-21 13:55:11,187 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family2/7b31f03ff7ab433fb4c5ea94135b0d63 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/7b31f03ff7ab433fb4c5ea94135b0d63 2023-11-21 13:55:11,189 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/08c9168407a946debf88df93938065a2, entries=4, sequenceid=13, filesize=5.4 K 2023-11-21 13:55:11,190 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family2/8a0bfb9aaea443ce937260a1c1b4218b as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/8a0bfb9aaea443ce937260a1c1b4218b 2023-11-21 13:55:11,190 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/7b31f03ff7ab433fb4c5ea94135b0d63, entries=2, sequenceid=13, filesize=5.1 K 2023-11-21 13:55:11,191 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 489c1aeed0cfc5efd1e74cd4f52c14b7 in 1264ms, sequenceid=13, compaction requested=true 2023-11-21 13:55:11,191 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 489c1aeed0cfc5efd1e74cd4f52c14b7: 2023-11-21 13:55:11,191 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:11,191 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-21 13:55:11,194 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/8a0bfb9aaea443ce937260a1c1b4218b, entries=2, sequenceid=13, filesize=5.1 K 2023-11-21 13:55:11,195 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 2c2220da91c79539696a8094984e331e in 1266ms, sequenceid=13, compaction requested=true 2023-11-21 13:55:11,195 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2c2220da91c79539696a8094984e331e: 2023-11-21 13:55:11,195 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:11,195 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-21 13:55:11,580 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family2/cc1e2abdb8b84b0a8e5b474cdb792e45 2023-11-21 13:55:11,585 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family1/8c0ab801c71b4268811d600415bb2ac7 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/8c0ab801c71b4268811d600415bb2ac7 2023-11-21 13:55:11,589 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/8c0ab801c71b4268811d600415bb2ac7, entries=4, sequenceid=13, filesize=5.4 K 2023-11-21 13:55:11,590 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family2/cc1e2abdb8b84b0a8e5b474cdb792e45 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/cc1e2abdb8b84b0a8e5b474cdb792e45 2023-11-21 13:55:11,595 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/cc1e2abdb8b84b0a8e5b474cdb792e45, entries=2, sequenceid=13, filesize=5.1 K 2023-11-21 13:55:11,596 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a3726db2a6d35a4ace20911e14a84575 in 1669ms, sequenceid=13, compaction requested=true 2023-11-21 13:55:11,596 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a3726db2a6d35a4ace20911e14a84575: 2023-11-21 13:55:11,596 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:11,596 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-21 13:55:11,596 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-21 13:55:11,596 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:11,596 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-21 13:55:11,596 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-21 13:55:11,598 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:11,598 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:11,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:11,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:11,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:11,598 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:11,598 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:11,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:11,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:11,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:11,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:11,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:11,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-21 13:55:11,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31cf30f4[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:11,600 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-21 13:55:11,600 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:11,601 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:11,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:11,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:11,601 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:11,601 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:11,601 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-21 13:55:11,601 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-21 13:55:11,601 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:11,604 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-21 13:55:11,604 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:11,604 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:11,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:11,604 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-21 13:55:11,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:11,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:11,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:11,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:11,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:11,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:11,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:11,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:11,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:11,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:11,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-21 13:55:11,607 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-21 13:55:11,607 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:11,607 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:11,607 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-21 13:55:11,607 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:11,609 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:11,609 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:11,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:11,609 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:11,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:11,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:11,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:11,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:11,609 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:11,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:11,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:11,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:11,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:11,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:11,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:11,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:11,611 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:11,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:11,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:11,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:11,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:11,613 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:11,613 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:11,613 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:11,614 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:11,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-21 13:55:11,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:11,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:11,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:11,613 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:11,614 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:11,614 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:11,614 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:11,614 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:11,614 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:11,614 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:11,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:11,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-21 13:55:11,614 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:11,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:11,714 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:11,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:11,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:11,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:11,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:11,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:11,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:11,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-21 13:55:11,721 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-21 13:55:11,721 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:11,721 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-21 13:55:11,721 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-21 13:55:11,722 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:11,722 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:11,723 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:11,723 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:11,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:11,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:11,723 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:11,723 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:11,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:11,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:11,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:11,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:11,724 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-21 13:55:11,724 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-21 13:55:11,724 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-21 13:55:11,725 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-21 13:55:11,725 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:11,725 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-21 13:55:11,730 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:11,730 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. started... 2023-11-21 13:55:11,730 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:11,731 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:11,731 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. started... 2023-11-21 13:55:11,730 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-21 13:55:11,731 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 489c1aeed0cfc5efd1e74cd4f52c14b7 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-21 13:55:11,731 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. started... 2023-11-21 13:55:11,731 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2c2220da91c79539696a8094984e331e 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-21 13:55:11,731 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a3726db2a6d35a4ace20911e14a84575 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-21 13:55:11,731 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:12,161 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231121b619ba38965f4976843c9f63139f217a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121b619ba38965f4976843c9f63139f217a 2023-11-21 13:55:12,161 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112181ef61da86b84d23ae5aeafb54c77cea to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112181ef61da86b84d23ae5aeafb54c77cea 2023-11-21 13:55:12,163 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231121ffd1c159ecbf4349af9e328e2916bd4c to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121ffd1c159ecbf4349af9e328e2916bd4c 2023-11-21 13:55:12,572 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family1/ba71260c9f2745e5bff68c68527fdd0a 2023-11-21 13:55:12,572 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family1/cd97572f1e9141dc889c7492f46cece6 2023-11-21 13:55:12,578 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family1/56443ee5aa1b4940986938fa8c027eea 2023-11-21 13:55:12,995 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311216ef3b09479b54f35801ac968d027814e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311216ef3b09479b54f35801ac968d027814e 2023-11-21 13:55:12,995 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311216cab875f93aa4edcbbc273f9347170e4 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311216cab875f93aa4edcbbc273f9347170e4 2023-11-21 13:55:12,996 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231121ca194cb70123480db75873be04d66098 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121ca194cb70123480db75873be04d66098 2023-11-21 13:55:13,352 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-21 13:55:13,405 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family2/7726f25dbada4e85a3299254e5fa012e 2023-11-21 13:55:13,405 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family2/c1dc51a16a0c40feaaaafdc263319ddb 2023-11-21 13:55:13,407 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family2/17d29f4adc654a13b4cada34bc7f4d31 2023-11-21 13:55:13,410 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family1/cd97572f1e9141dc889c7492f46cece6 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cd97572f1e9141dc889c7492f46cece6 2023-11-21 13:55:13,410 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family1/56443ee5aa1b4940986938fa8c027eea as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/56443ee5aa1b4940986938fa8c027eea 2023-11-21 13:55:13,411 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family1/ba71260c9f2745e5bff68c68527fdd0a as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/ba71260c9f2745e5bff68c68527fdd0a 2023-11-21 13:55:13,414 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cd97572f1e9141dc889c7492f46cece6, entries=4, sequenceid=17, filesize=5.4 K 2023-11-21 13:55:13,415 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/56443ee5aa1b4940986938fa8c027eea, entries=4, sequenceid=17, filesize=5.4 K 2023-11-21 13:55:13,415 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family2/7726f25dbada4e85a3299254e5fa012e as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/7726f25dbada4e85a3299254e5fa012e 2023-11-21 13:55:13,416 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family2/c1dc51a16a0c40feaaaafdc263319ddb as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/c1dc51a16a0c40feaaaafdc263319ddb 2023-11-21 13:55:13,416 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/ba71260c9f2745e5bff68c68527fdd0a, entries=4, sequenceid=17, filesize=5.4 K 2023-11-21 13:55:13,417 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family2/17d29f4adc654a13b4cada34bc7f4d31 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/17d29f4adc654a13b4cada34bc7f4d31 2023-11-21 13:55:13,427 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/7726f25dbada4e85a3299254e5fa012e, entries=2, sequenceid=17, filesize=5.1 K 2023-11-21 13:55:13,428 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/17d29f4adc654a13b4cada34bc7f4d31, entries=2, sequenceid=17, filesize=5.1 K 2023-11-21 13:55:13,428 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 2c2220da91c79539696a8094984e331e in 1697ms, sequenceid=17, compaction requested=true 2023-11-21 13:55:13,428 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a3726db2a6d35a4ace20911e14a84575 in 1697ms, sequenceid=17, compaction requested=true 2023-11-21 13:55:13,428 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2c2220da91c79539696a8094984e331e: 2023-11-21 13:55:13,428 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:13,428 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a3726db2a6d35a4ace20911e14a84575: 2023-11-21 13:55:13,428 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-21 13:55:13,428 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:13,429 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-21 13:55:13,431 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/c1dc51a16a0c40feaaaafdc263319ddb, entries=2, sequenceid=17, filesize=5.1 K 2023-11-21 13:55:13,431 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 489c1aeed0cfc5efd1e74cd4f52c14b7 in 1701ms, sequenceid=17, compaction requested=true 2023-11-21 13:55:13,431 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 489c1aeed0cfc5efd1e74cd4f52c14b7: 2023-11-21 13:55:13,431 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:13,431 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-21 13:55:13,432 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-21 13:55:13,432 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:13,432 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-21 13:55:13,432 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-21 13:55:13,433 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:13,433 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:13,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:13,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:13,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:13,434 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:13,434 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:13,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:13,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:13,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:13,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:13,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:13,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-21 13:55:13,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@224599cc[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:13,436 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-21 13:55:13,436 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:13,437 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:13,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:13,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:13,437 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-21 13:55:13,437 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-21 13:55:13,437 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:13,437 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:13,437 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:13,440 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:13,440 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-21 13:55:13,440 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:13,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:13,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:13,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:13,440 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-21 13:55:13,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:13,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:13,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:13,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:13,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:13,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:13,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:13,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:13,443 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-21 13:55:13,443 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:13,443 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:13,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-21 13:55:13,443 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-21 13:55:13,443 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:13,444 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:13,444 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:13,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:13,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:13,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:13,444 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:13,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:13,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:13,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:13,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:13,445 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:13,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:13,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:13,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:13,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:13,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:13,446 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:13,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:13,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:13,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:13,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:13,449 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:13,449 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:13,449 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:13,449 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:13,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-21 13:55:13,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-21 13:55:13,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:13,449 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:13,449 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:13,449 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:13,449 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:13,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:13,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:13,449 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:13,449 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:13,449 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:13,449 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:13,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:13,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:13,550 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:13,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:13,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1583): Client=jenkins//172.31.2.20 snapshot request for:{ ss=snaptb-1700574913551 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-21 13:55:13,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1700574913562 (current time:1700574913562). 2023-11-21 13:55:13,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-21 13:55:13,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] zookeeper.ReadOnlyZKClient(139): Connect 0x2606fa9a to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:55:13,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2edcee89, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:55:13,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:55:13,575 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:44308, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:55:13,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2606fa9a to 127.0.0.1:52369 2023-11-21 13:55:13,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:55:13,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-21 13:55:13,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1700574913551 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-21 13:55:13,592 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.hbase-snapshot, current working dir path: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.hbase-snapshot/.tmp/snaptb-1700574913551 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-21 13:55:13,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-21 13:55:13,600 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-21 13:55:13,601 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1700575513601 2023-11-21 13:55:13,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1700574913551 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-21 13:55:13,601 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1700574913551 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-21 13:55:13,602 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-21 13:55:13,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-21 13:55:13,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-11-21 13:55:13,604 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-21 13:55:13,604 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1700575513604 2023-11-21 13:55:13,606 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1700574913551 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:13,606 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-21 13:55:13,706 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-21 13:55:13,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700574913551 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-21 13:55:13,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700574913551 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-21 13:55:13,710 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-21 13:55:13,910 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-21 13:55:13,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700574913551 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-21 13:55:13,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700574913551 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-21 13:55:13,911 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-21 13:55:14,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1700574913551 2023-11-21 13:55:14,011 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1700574913551' 2023-11-21 13:55:14,011 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-21 13:55:14,011 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1700574913551' starting 'acquire' 2023-11-21 13:55:14,011 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1700574913551', kicking off acquire phase on members. 2023-11-21 13:55:14,011 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1700574913551 2023-11-21 13:55:14,011 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1700574913551 2023-11-21 13:55:14,012 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1700574913551/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:14,012 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-21 13:55:14,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-21 13:55:14,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-21 13:55:14,013 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1700574913551/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:14,013 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:14,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1700574913551 2023-11-21 13:55:14,013 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1700574913551 2023-11-21 13:55:14,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-21 13:55:14,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1700574913551 2023-11-21 13:55:14,014 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1700574913551 from table testCompactionWithHFileLink type FLUSH 2023-11-21 13:55:14,015 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1700574913551 2023-11-21 13:55:14,016 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1700574913551' with timeout 300000ms 2023-11-21 13:55:14,016 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-21 13:55:14,016 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1700574913551' starting 'acquire' stage 2023-11-21 13:55:14,016 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1700574913551' locally acquired 2023-11-21 13:55:14,016 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (snaptb-1700574913551) in zk 2023-11-21 13:55:14,018 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700574913551/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:14,018 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1700574913551 2023-11-21 13:55:14,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1700574913551/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:14,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:14,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-21 13:55:14,018 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1700574913551 2023-11-21 13:55:14,018 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1700574913551' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:14,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:14,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:14,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700574913551 2023-11-21 13:55:14,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:14,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:14,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'snaptb-1700574913551' on coordinator 2023-11-21 13:55:14,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49aa6904[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:14,020 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1700574913551' starting 'in-barrier' execution. 2023-11-21 13:55:14,020 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1700574913551 2023-11-21 13:55:14,021 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700574913551 2023-11-21 13:55:14,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1700574913551 2023-11-21 13:55:14,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1700574913551 2023-11-21 13:55:14,021 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1700574913551' received 'reached' from coordinator. 2023-11-21 13:55:14,021 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1700574913551/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:14,021 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:14,022 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:14,022 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-21 13:55:14,022 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:14,022 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-21 13:55:14,022 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:14,023 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. started... 2023-11-21 13:55:14,023 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. started... 2023-11-21 13:55:14,023 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. started... 2023-11-21 13:55:14,023 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 489c1aeed0cfc5efd1e74cd4f52c14b7: 2023-11-21 13:55:14,023 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for a3726db2a6d35a4ace20911e14a84575: 2023-11-21 13:55:14,023 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 2c2220da91c79539696a8094984e331e: 2023-11-21 13:55:14,023 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575.' region-info for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,023 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e.' region-info for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,023 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7.' region-info for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,029 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-21 13:55:14,029 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-21 13:55:14,029 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-21 13:55:14,032 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/625ff5eabac64bcd9f0e5ba027931c53, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cd9a918c980747cb955ab2f73dee69a6, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/08c9168407a946debf88df93938065a2, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cd97572f1e9141dc889c7492f46cece6] hfiles 2023-11-21 13:55:14,032 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/06b3d411f57145f99e7bb0ad83ecbcb8, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/833631d8fbac4f798e75e0acd31d627d, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/8c0ab801c71b4268811d600415bb2ac7, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/ba71260c9f2745e5bff68c68527fdd0a] hfiles 2023-11-21 13:55:14,032 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/2d7339555d73468f8a547deac0e4da1f, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/5ac3b165f9eb4dcf896fc3fc1071be28, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/5d43ef103d274dc3a9bb93309c6608d8, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/56443ee5aa1b4940986938fa8c027eea] hfiles 2023-11-21 13:55:14,032 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/06b3d411f57145f99e7bb0ad83ecbcb8 for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,032 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/625ff5eabac64bcd9f0e5ba027931c53 for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,032 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/2d7339555d73468f8a547deac0e4da1f for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,035 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/833631d8fbac4f798e75e0acd31d627d for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,035 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/5ac3b165f9eb4dcf896fc3fc1071be28 for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,035 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cd9a918c980747cb955ab2f73dee69a6 for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/5d43ef103d274dc3a9bb93309c6608d8 for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/8c0ab801c71b4268811d600415bb2ac7 for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/56443ee5aa1b4940986938fa8c027eea for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/08c9168407a946debf88df93938065a2 for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/ba71260c9f2745e5bff68c68527fdd0a for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cd97572f1e9141dc889c7492f46cece6 for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/7cacaaa69f874133add2611b3499950e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/fe584384e451421e966c64b193ca6784, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/cc1e2abdb8b84b0a8e5b474cdb792e45, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/17d29f4adc654a13b4cada34bc7f4d31] hfiles 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/7669c129d1c947e2b93c80da48fe282d, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/9cefbb6708ea467c83688fd844c68bb7, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/8a0bfb9aaea443ce937260a1c1b4218b, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/7726f25dbada4e85a3299254e5fa012e] hfiles 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/7669c129d1c947e2b93c80da48fe282d for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/7cacaaa69f874133add2611b3499950e for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/2813c6537fff4fc5970e0d660f5a3b9a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/5502cef6742140928005a8fc6f731c04, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/7b31f03ff7ab433fb4c5ea94135b0d63, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/c1dc51a16a0c40feaaaafdc263319ddb] hfiles 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/2813c6537fff4fc5970e0d660f5a3b9a for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/fe584384e451421e966c64b193ca6784 for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/9cefbb6708ea467c83688fd844c68bb7 for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/cc1e2abdb8b84b0a8e5b474cdb792e45 for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/5502cef6742140928005a8fc6f731c04 for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/17d29f4adc654a13b4cada34bc7f4d31 for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/8a0bfb9aaea443ce937260a1c1b4218b for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/7b31f03ff7ab433fb4c5ea94135b0d63 for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/7726f25dbada4e85a3299254e5fa012e for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,036 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/c1dc51a16a0c40feaaaafdc263319ddb for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,048 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. completed. 2023-11-21 13:55:14,048 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:14,049 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-21 13:55:14,211 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-21 13:55:14,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700574913551 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-21 13:55:14,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700574913551 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-21 13:55:14,213 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-21 13:55:14,445 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. completed. 2023-11-21 13:55:14,445 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:14,445 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-21 13:55:14,448 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. completed. 2023-11-21 13:55:14,448 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:14,448 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-21 13:55:14,448 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-21 13:55:14,448 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:14,448 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1700574913551' locally completed 2023-11-21 13:55:14,448 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1700574913551' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:14,450 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700574913551/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:14,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1700574913551/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:14,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:14,450 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1700574913551' has notified controller of completion 2023-11-21 13:55:14,451 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:14,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-21 13:55:14,451 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1700574913551' completed. 2023-11-21 13:55:14,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:14,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:14,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700574913551 2023-11-21 13:55:14,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:14,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:14,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700574913551 2023-11-21 13:55:14,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:14,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1700574913551' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:14,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'snaptb-1700574913551', counting down latch. Waiting for 0 more 2023-11-21 13:55:14,456 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1700574913551' execution completed 2023-11-21 13:55:14,456 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:14,456 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:14,456 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1700574913551 2023-11-21 13:55:14,456 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1700574913551including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-21 13:55:14,458 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700574913551 2023-11-21 13:55:14,458 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700574913551 2023-11-21 13:55:14,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1700574913551 2023-11-21 13:55:14,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:14,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-21 13:55:14,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1700574913551 2023-11-21 13:55:14,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1700574913551 2023-11-21 13:55:14,458 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-21 13:55:14,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-21 13:55:14,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-21 13:55:14,459 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1700574913551/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:14,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:14,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1700574913551 2023-11-21 13:55:14,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700574913551 2023-11-21 13:55:14,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:14,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700574913551 2023-11-21 13:55:14,461 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1700574913551/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:14,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:14,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:14,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700574913551 2023-11-21 13:55:14,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:14,469 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700574913551/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:14,469 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700574913551 2023-11-21 13:55:14,469 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-21 13:55:14,469 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-21 13:55:14,469 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700574913551 2023-11-21 13:55:14,469 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1700574913551 because node does not exist (not an error) 2023-11-21 13:55:14,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-21 13:55:14,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-21 13:55:14,469 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:14,469 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1700574913551 2023-11-21 13:55:14,469 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700574913551/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:14,469 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700574913551 2023-11-21 13:55:14,469 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-21 13:55:14,469 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700574913551 2023-11-21 13:55:14,469 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700574913551 2023-11-21 13:55:14,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1700574913551 2023-11-21 13:55:14,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-21 13:55:14,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-21 13:55:14,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-21 13:55:14,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121b2f42049d02a4b37a43e96962c985b9e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121f8a34cc10a484ecba803bde3af1ea1bf, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121fdc3a9147e0b46dc9d057989571b4a9a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121ffd1c159ecbf4349af9e328e2916bd4c, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121477c593f302a4ebb8e41d1f4bc2d3465, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121481ced72e8634a0e8e51921117a1da00, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121b619ba38965f4976843c9f63139f217a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121d370efe300e447308cc51bb4e12ae2ab, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311210fa8109b150d464882a6f44b66b5d449, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112181ef61da86b84d23ae5aeafb54c77cea, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311219416ad37fc114e388efa2d0add8e46e8, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231121ec7e5d4ccdd649ea9c5552974861856b] mob files 2023-11-21 13:55:14,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121b2f42049d02a4b37a43e96962c985b9e 2023-11-21 13:55:14,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121f8a34cc10a484ecba803bde3af1ea1bf 2023-11-21 13:55:14,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121fdc3a9147e0b46dc9d057989571b4a9a 2023-11-21 13:55:14,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121ffd1c159ecbf4349af9e328e2916bd4c 2023-11-21 13:55:14,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121477c593f302a4ebb8e41d1f4bc2d3465 2023-11-21 13:55:14,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121481ced72e8634a0e8e51921117a1da00 2023-11-21 13:55:14,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121b619ba38965f4976843c9f63139f217a 2023-11-21 13:55:14,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121d370efe300e447308cc51bb4e12ae2ab 2023-11-21 13:55:14,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311210fa8109b150d464882a6f44b66b5d449 2023-11-21 13:55:14,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112181ef61da86b84d23ae5aeafb54c77cea 2023-11-21 13:55:14,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311219416ad37fc114e388efa2d0add8e46e8 2023-11-21 13:55:14,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231121ec7e5d4ccdd649ea9c5552974861856b 2023-11-21 13:55:14,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311216923139c965840299e665c44b6cb98c9, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121ca194cb70123480db75873be04d66098, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121cb012e713e4e4ab292ed072251cea2db, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121d136640b5a6b41af9d5de66c82e37e14, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311213096bec9232e4605b68cfba4e678a0ee, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311216cab875f93aa4edcbbc273f9347170e4, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231121913e3e229c234fee9459e2d35af96173, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231121e1bd2d3eb39d4852ae82bc3d046cef8a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311216ef3b09479b54f35801ac968d027814e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231121766edc502d624c0bade967778f48e606, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311218fed1aa0338342c0a4afa0b9e0a9556e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231121dc2b6625d69342f58bc7d49093db58b1] mob files 2023-11-21 13:55:14,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311216923139c965840299e665c44b6cb98c9 2023-11-21 13:55:14,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121ca194cb70123480db75873be04d66098 2023-11-21 13:55:14,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121cb012e713e4e4ab292ed072251cea2db 2023-11-21 13:55:14,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121d136640b5a6b41af9d5de66c82e37e14 2023-11-21 13:55:14,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311213096bec9232e4605b68cfba4e678a0ee 2023-11-21 13:55:14,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311216cab875f93aa4edcbbc273f9347170e4 2023-11-21 13:55:14,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231121913e3e229c234fee9459e2d35af96173 2023-11-21 13:55:14,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231121e1bd2d3eb39d4852ae82bc3d046cef8a 2023-11-21 13:55:14,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311216ef3b09479b54f35801ac968d027814e 2023-11-21 13:55:14,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231121766edc502d624c0bade967778f48e606 2023-11-21 13:55:14,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311218fed1aa0338342c0a4afa0b9e0a9556e 2023-11-21 13:55:14,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231121dc2b6625d69342f58bc7d49093db58b1 2023-11-21 13:55:14,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1700574913551 2023-11-21 13:55:14,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.hbase-snapshot/.tmp/snaptb-1700574913551 2023-11-21 13:55:14,713 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-21 13:55:14,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700574913551 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-21 13:55:14,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700574913551 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-21 13:55:14,714 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-21 13:55:14,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.hbase-snapshot/.tmp/snaptb-1700574913551 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.hbase-snapshot/snaptb-1700574913551 2023-11-21 13:55:14,932 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1700574913551 of table testCompactionWithHFileLink completed 2023-11-21 13:55:14,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.hbase-snapshot/.tmp/snaptb-1700574913551 2023-11-21 13:55:14,933 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.hbase-snapshot/.tmp/snaptb-1700574913551 2023-11-21 13:55:14,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1700574913551 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1700574913601Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1700574914477 (+876 ms)Consolidate snapshot: snaptb-1700574913551 at 1700574914477Loading Region manifests for snaptb-1700574913551 at 1700574914478 (+1 ms)Writing data manifest for snaptb-1700574913551 at 1700574914498 (+20 ms)Verifying snapshot: snaptb-1700574913551 at 1700574914906 (+408 ms)Snapshot snaptb-1700574913551 of table testCompactionWithHFileLink completed at 1700574914932 (+26 ms) 2023-11-21 13:55:14,934 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-21 13:55:14,935 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.3320 sec 2023-11-21 13:55:15,714 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-21 13:55:15,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700574913551 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-21 13:55:15,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1700574913551 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-21 13:55:15,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:15,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:15,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-21 13:55:15,745 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-21 13:55:15,745 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:15,745 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-21 13:55:15,745 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-21 13:55:15,746 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:15,746 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:15,747 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:15,747 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:15,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:15,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:15,747 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:15,747 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:15,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:15,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:15,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:15,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:15,748 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-21 13:55:15,748 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-21 13:55:15,749 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-21 13:55:15,749 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-21 13:55:15,749 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:15,749 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-21 13:55:15,749 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:15,749 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. started... 2023-11-21 13:55:15,749 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:15,749 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. started... 2023-11-21 13:55:15,749 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 489c1aeed0cfc5efd1e74cd4f52c14b7 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-21 13:55:15,749 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-21 13:55:15,749 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:15,749 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a3726db2a6d35a4ace20911e14a84575 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-21 13:55:15,749 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:15,749 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. started... 2023-11-21 13:55:15,749 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2c2220da91c79539696a8094984e331e 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-21 13:55:16,173 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family1/baeac4f5f4b9430d9ecb1edc8ca3f18d 2023-11-21 13:55:16,173 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family1/420f58716b094664ab403467c6800222 2023-11-21 13:55:16,180 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for baeac4f5f4b9430d9ecb1edc8ca3f18d 2023-11-21 13:55:16,180 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 420f58716b094664ab403467c6800222 2023-11-21 13:55:16,569 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family1/e962c1c218fe48ebb94ee26d01d635a0 2023-11-21 13:55:16,572 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e962c1c218fe48ebb94ee26d01d635a0 2023-11-21 13:55:16,985 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family2/badc53157b0a4a08801a9d520d181ecc 2023-11-21 13:55:16,990 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for badc53157b0a4a08801a9d520d181ecc 2023-11-21 13:55:16,991 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family1/e962c1c218fe48ebb94ee26d01d635a0 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/e962c1c218fe48ebb94ee26d01d635a0 2023-11-21 13:55:16,995 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e962c1c218fe48ebb94ee26d01d635a0 2023-11-21 13:55:16,996 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/e962c1c218fe48ebb94ee26d01d635a0, entries=3, sequenceid=24, filesize=5.0 K 2023-11-21 13:55:16,996 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family2/badc53157b0a4a08801a9d520d181ecc as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/badc53157b0a4a08801a9d520d181ecc 2023-11-21 13:55:17,000 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for badc53157b0a4a08801a9d520d181ecc 2023-11-21 13:55:17,001 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/badc53157b0a4a08801a9d520d181ecc, entries=1, sequenceid=24, filesize=5.0 K 2023-11-21 13:55:17,001 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a3726db2a6d35a4ace20911e14a84575 in 1252ms, sequenceid=24, compaction requested=true 2023-11-21 13:55:17,001 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a3726db2a6d35a4ace20911e14a84575: 2023-11-21 13:55:17,001 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:17,001 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-21 13:55:17,004 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family2/d2ef10cc398f494ca2bf0e688e9aafbd 2023-11-21 13:55:17,004 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family2/4d91d02270de4ef19b41bba4e56b69b2 2023-11-21 13:55:17,008 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2ef10cc398f494ca2bf0e688e9aafbd 2023-11-21 13:55:17,008 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d91d02270de4ef19b41bba4e56b69b2 2023-11-21 13:55:17,009 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family1/baeac4f5f4b9430d9ecb1edc8ca3f18d as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/baeac4f5f4b9430d9ecb1edc8ca3f18d 2023-11-21 13:55:17,009 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family1/420f58716b094664ab403467c6800222 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/420f58716b094664ab403467c6800222 2023-11-21 13:55:17,013 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for baeac4f5f4b9430d9ecb1edc8ca3f18d 2023-11-21 13:55:17,013 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/baeac4f5f4b9430d9ecb1edc8ca3f18d, entries=3, sequenceid=24, filesize=5.0 K 2023-11-21 13:55:17,013 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 420f58716b094664ab403467c6800222 2023-11-21 13:55:17,013 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/420f58716b094664ab403467c6800222, entries=3, sequenceid=24, filesize=5.0 K 2023-11-21 13:55:17,019 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family2/d2ef10cc398f494ca2bf0e688e9aafbd as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/d2ef10cc398f494ca2bf0e688e9aafbd 2023-11-21 13:55:17,019 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family2/4d91d02270de4ef19b41bba4e56b69b2 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/4d91d02270de4ef19b41bba4e56b69b2 2023-11-21 13:55:17,031 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2ef10cc398f494ca2bf0e688e9aafbd 2023-11-21 13:55:17,031 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/d2ef10cc398f494ca2bf0e688e9aafbd, entries=1, sequenceid=24, filesize=5.0 K 2023-11-21 13:55:17,032 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d91d02270de4ef19b41bba4e56b69b2 2023-11-21 13:55:17,032 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/4d91d02270de4ef19b41bba4e56b69b2, entries=1, sequenceid=24, filesize=5.0 K 2023-11-21 13:55:17,032 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 489c1aeed0cfc5efd1e74cd4f52c14b7 in 1283ms, sequenceid=24, compaction requested=true 2023-11-21 13:55:17,032 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 489c1aeed0cfc5efd1e74cd4f52c14b7: 2023-11-21 13:55:17,032 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:17,032 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-21 13:55:17,033 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 2c2220da91c79539696a8094984e331e in 1284ms, sequenceid=24, compaction requested=true 2023-11-21 13:55:17,033 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2c2220da91c79539696a8094984e331e: 2023-11-21 13:55:17,033 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:17,033 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-21 13:55:17,033 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-21 13:55:17,033 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:17,033 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-21 13:55:17,033 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-21 13:55:17,036 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:17,036 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:17,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:17,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:17,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:17,036 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:17,036 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:17,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:17,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:17,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:17,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:17,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:17,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-21 13:55:17,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3308a998[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:17,038 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-21 13:55:17,038 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:17,039 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:17,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:17,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:17,039 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-21 13:55:17,039 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-21 13:55:17,039 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:17,039 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:17,039 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:17,041 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:17,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:17,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:17,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:17,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:17,042 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-21 13:55:17,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:17,042 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:17,042 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-21 13:55:17,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:17,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:17,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:17,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:17,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:17,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:17,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-21 13:55:17,044 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-21 13:55:17,044 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:17,044 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:17,044 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-21 13:55:17,044 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:17,047 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:17,047 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:17,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:17,047 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:17,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:17,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:17,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:17,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:17,047 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:17,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:17,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:17,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:17,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:17,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:17,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:17,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:17,049 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:17,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:17,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:17,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-21 13:55:17,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:17,051 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:17,051 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:17,051 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:17,052 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:17,052 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-21 13:55:17,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-21 13:55:17,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:17,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:17,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:17,052 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:17,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-21 13:55:17,052 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:17,052 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:17,052 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:17,052 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:17,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:17,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:17,052 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-21 13:55:17,052 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-21 13:55:17,152 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:17,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:17,154 DEBUG [Listener at localhost/35077] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:55:17,154 DEBUG [Listener at localhost/35077] regionserver.HStore(1912): 489c1aeed0cfc5efd1e74cd4f52c14b7/family1 is initiating major compaction (all files) 2023-11-21 13:55:17,155 INFO [Listener at localhost/35077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:55:17,155 INFO [Listener at localhost/35077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:55:17,155 INFO [Listener at localhost/35077] regionserver.HRegion(2259): Starting compaction of 489c1aeed0cfc5efd1e74cd4f52c14b7/family1 in testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:17,155 INFO [Listener at localhost/35077] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/2d7339555d73468f8a547deac0e4da1f, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/5ac3b165f9eb4dcf896fc3fc1071be28, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/5d43ef103d274dc3a9bb93309c6608d8, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/56443ee5aa1b4940986938fa8c027eea, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/baeac4f5f4b9430d9ecb1edc8ca3f18d] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp, totalSize=26.7 K 2023-11-21 13:55:17,156 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 2d7339555d73468f8a547deac0e4da1f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574906720 2023-11-21 13:55:17,157 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 5ac3b165f9eb4dcf896fc3fc1071be28, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574908523 2023-11-21 13:55:17,158 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 5d43ef103d274dc3a9bb93309c6608d8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574909916 2023-11-21 13:55:17,158 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 56443ee5aa1b4940986938fa8c027eea, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574911716 2023-11-21 13:55:17,159 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting baeac4f5f4b9430d9ecb1edc8ca3f18d, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-21 13:55:17,187 INFO [Listener at localhost/35077] throttle.PressureAwareThroughputController(145): 489c1aeed0cfc5efd1e74cd4f52c14b7#family1#compaction#108 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:55:17,205 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311217d799a23259a46eaa8c779e007e9221b_del 2023-11-21 13:55:17,205 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311217d799a23259a46eaa8c779e007e9221b_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311217d799a23259a46eaa8c779e007e9221b_del 2023-11-21 13:55:17,230 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e8ed4eb270f43a582c8025ea42181e9 2023-11-21 13:55:17,231 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family1/4e8ed4eb270f43a582c8025ea42181e9 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/4e8ed4eb270f43a582c8025ea42181e9 2023-11-21 13:55:17,235 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e8ed4eb270f43a582c8025ea42181e9 2023-11-21 13:55:17,236 INFO [Listener at localhost/35077] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 489c1aeed0cfc5efd1e74cd4f52c14b7/family1 of 489c1aeed0cfc5efd1e74cd4f52c14b7 into 4e8ed4eb270f43a582c8025ea42181e9(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:55:17,236 DEBUG [Listener at localhost/35077] regionserver.HRegion(2289): Compaction status journal for 489c1aeed0cfc5efd1e74cd4f52c14b7: 2023-11-21 13:55:17,237 DEBUG [Listener at localhost/35077] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:55:17,237 DEBUG [Listener at localhost/35077] regionserver.HStore(1912): 489c1aeed0cfc5efd1e74cd4f52c14b7/family2 is initiating major compaction (all files) 2023-11-21 13:55:17,237 INFO [Listener at localhost/35077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:55:17,237 INFO [Listener at localhost/35077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:55:17,238 INFO [Listener at localhost/35077] regionserver.HRegion(2259): Starting compaction of 489c1aeed0cfc5efd1e74cd4f52c14b7/family2 in testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:17,238 INFO [Listener at localhost/35077] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/2813c6537fff4fc5970e0d660f5a3b9a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/5502cef6742140928005a8fc6f731c04, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/7b31f03ff7ab433fb4c5ea94135b0d63, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/c1dc51a16a0c40feaaaafdc263319ddb, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/d2ef10cc398f494ca2bf0e688e9aafbd] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp, totalSize=25.4 K 2023-11-21 13:55:17,238 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 2813c6537fff4fc5970e0d660f5a3b9a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574906720 2023-11-21 13:55:17,239 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 5502cef6742140928005a8fc6f731c04, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574908523 2023-11-21 13:55:17,239 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 7b31f03ff7ab433fb4c5ea94135b0d63, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574909916 2023-11-21 13:55:17,240 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting c1dc51a16a0c40feaaaafdc263319ddb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574911716 2023-11-21 13:55:17,240 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting d2ef10cc398f494ca2bf0e688e9aafbd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-21 13:55:17,271 INFO [Listener at localhost/35077] throttle.PressureAwareThroughputController(145): 489c1aeed0cfc5efd1e74cd4f52c14b7#family2#compaction#109 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:55:17,280 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231121943d9378e03a4e6eb6f9a7bbbb2a8476_del 2023-11-21 13:55:17,280 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231121943d9378e03a4e6eb6f9a7bbbb2a8476_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121943d9378e03a4e6eb6f9a7bbbb2a8476_del 2023-11-21 13:55:17,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/2d7339555d73468f8a547deac0e4da1f, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/5ac3b165f9eb4dcf896fc3fc1071be28, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/5d43ef103d274dc3a9bb93309c6608d8, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/56443ee5aa1b4940986938fa8c027eea, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/baeac4f5f4b9430d9ecb1edc8ca3f18d] to archive 2023-11-21 13:55:17,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:17,316 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/2d7339555d73468f8a547deac0e4da1f to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/2d7339555d73468f8a547deac0e4da1f 2023-11-21 13:55:17,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/5ac3b165f9eb4dcf896fc3fc1071be28 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/5ac3b165f9eb4dcf896fc3fc1071be28 2023-11-21 13:55:17,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/5d43ef103d274dc3a9bb93309c6608d8 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/5d43ef103d274dc3a9bb93309c6608d8 2023-11-21 13:55:17,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/56443ee5aa1b4940986938fa8c027eea to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/56443ee5aa1b4940986938fa8c027eea 2023-11-21 13:55:17,321 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/baeac4f5f4b9430d9ecb1edc8ca3f18d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/baeac4f5f4b9430d9ecb1edc8ca3f18d 2023-11-21 13:55:18,106 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c299d89bf6924d138cb218e4919e589b 2023-11-21 13:55:18,107 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family2/c299d89bf6924d138cb218e4919e589b as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/c299d89bf6924d138cb218e4919e589b 2023-11-21 13:55:18,111 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c299d89bf6924d138cb218e4919e589b 2023-11-21 13:55:18,112 INFO [Listener at localhost/35077] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 489c1aeed0cfc5efd1e74cd4f52c14b7/family2 of 489c1aeed0cfc5efd1e74cd4f52c14b7 into c299d89bf6924d138cb218e4919e589b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:55:18,113 DEBUG [Listener at localhost/35077] regionserver.HRegion(2289): Compaction status journal for 489c1aeed0cfc5efd1e74cd4f52c14b7: 2023-11-21 13:55:18,113 DEBUG [Listener at localhost/35077] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:55:18,113 DEBUG [Listener at localhost/35077] regionserver.HStore(1912): a3726db2a6d35a4ace20911e14a84575/family1 is initiating major compaction (all files) 2023-11-21 13:55:18,113 INFO [Listener at localhost/35077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:55:18,113 INFO [Listener at localhost/35077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:55:18,113 INFO [Listener at localhost/35077] regionserver.HRegion(2259): Starting compaction of a3726db2a6d35a4ace20911e14a84575/family1 in testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:18,113 INFO [Listener at localhost/35077] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/06b3d411f57145f99e7bb0ad83ecbcb8, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/833631d8fbac4f798e75e0acd31d627d, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/8c0ab801c71b4268811d600415bb2ac7, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/ba71260c9f2745e5bff68c68527fdd0a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/e962c1c218fe48ebb94ee26d01d635a0] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp, totalSize=26.7 K 2023-11-21 13:55:18,114 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 06b3d411f57145f99e7bb0ad83ecbcb8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574906721 2023-11-21 13:55:18,114 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/2813c6537fff4fc5970e0d660f5a3b9a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/5502cef6742140928005a8fc6f731c04, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/7b31f03ff7ab433fb4c5ea94135b0d63, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/c1dc51a16a0c40feaaaafdc263319ddb, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/d2ef10cc398f494ca2bf0e688e9aafbd] to archive 2023-11-21 13:55:18,115 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 833631d8fbac4f798e75e0acd31d627d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574908524 2023-11-21 13:55:18,115 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 8c0ab801c71b4268811d600415bb2ac7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574909916 2023-11-21 13:55:18,115 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:18,116 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting ba71260c9f2745e5bff68c68527fdd0a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574911716 2023-11-21 13:55:18,117 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting e962c1c218fe48ebb94ee26d01d635a0, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-21 13:55:18,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/2813c6537fff4fc5970e0d660f5a3b9a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/2813c6537fff4fc5970e0d660f5a3b9a 2023-11-21 13:55:18,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/5502cef6742140928005a8fc6f731c04 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/5502cef6742140928005a8fc6f731c04 2023-11-21 13:55:18,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/7b31f03ff7ab433fb4c5ea94135b0d63 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/7b31f03ff7ab433fb4c5ea94135b0d63 2023-11-21 13:55:18,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/c1dc51a16a0c40feaaaafdc263319ddb to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/c1dc51a16a0c40feaaaafdc263319ddb 2023-11-21 13:55:18,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/d2ef10cc398f494ca2bf0e688e9aafbd to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/d2ef10cc398f494ca2bf0e688e9aafbd 2023-11-21 13:55:18,133 INFO [Listener at localhost/35077] throttle.PressureAwareThroughputController(145): a3726db2a6d35a4ace20911e14a84575#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:55:18,153 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311213e07cfb08b7c4767979d777ae626cfd1_del 2023-11-21 13:55:18,153 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311213e07cfb08b7c4767979d777ae626cfd1_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311213e07cfb08b7c4767979d777ae626cfd1_del 2023-11-21 13:55:18,177 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c66b739149a7453f974911c279d28d76 2023-11-21 13:55:18,178 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family1/c66b739149a7453f974911c279d28d76 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/c66b739149a7453f974911c279d28d76 2023-11-21 13:55:18,183 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c66b739149a7453f974911c279d28d76 2023-11-21 13:55:18,184 INFO [Listener at localhost/35077] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a3726db2a6d35a4ace20911e14a84575/family1 of a3726db2a6d35a4ace20911e14a84575 into c66b739149a7453f974911c279d28d76(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:55:18,184 DEBUG [Listener at localhost/35077] regionserver.HRegion(2289): Compaction status journal for a3726db2a6d35a4ace20911e14a84575: 2023-11-21 13:55:18,184 DEBUG [Listener at localhost/35077] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:55:18,184 DEBUG [Listener at localhost/35077] regionserver.HStore(1912): a3726db2a6d35a4ace20911e14a84575/family2 is initiating major compaction (all files) 2023-11-21 13:55:18,185 INFO [Listener at localhost/35077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:55:18,185 INFO [Listener at localhost/35077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:55:18,185 INFO [Listener at localhost/35077] regionserver.HRegion(2259): Starting compaction of a3726db2a6d35a4ace20911e14a84575/family2 in testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:18,185 INFO [Listener at localhost/35077] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/7cacaaa69f874133add2611b3499950e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/fe584384e451421e966c64b193ca6784, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/cc1e2abdb8b84b0a8e5b474cdb792e45, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/17d29f4adc654a13b4cada34bc7f4d31, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/badc53157b0a4a08801a9d520d181ecc] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp, totalSize=25.4 K 2023-11-21 13:55:18,185 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 7cacaaa69f874133add2611b3499950e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574906721 2023-11-21 13:55:18,186 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting fe584384e451421e966c64b193ca6784, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574908524 2023-11-21 13:55:18,186 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting cc1e2abdb8b84b0a8e5b474cdb792e45, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574909916 2023-11-21 13:55:18,187 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 17d29f4adc654a13b4cada34bc7f4d31, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574911716 2023-11-21 13:55:18,187 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting badc53157b0a4a08801a9d520d181ecc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-21 13:55:18,208 INFO [Listener at localhost/35077] throttle.PressureAwareThroughputController(145): a3726db2a6d35a4ace20911e14a84575#family2#compaction#111 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:55:18,214 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/06b3d411f57145f99e7bb0ad83ecbcb8, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/833631d8fbac4f798e75e0acd31d627d, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/8c0ab801c71b4268811d600415bb2ac7, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/ba71260c9f2745e5bff68c68527fdd0a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/e962c1c218fe48ebb94ee26d01d635a0] to archive 2023-11-21 13:55:18,215 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:18,216 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/06b3d411f57145f99e7bb0ad83ecbcb8 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/06b3d411f57145f99e7bb0ad83ecbcb8 2023-11-21 13:55:18,218 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/833631d8fbac4f798e75e0acd31d627d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/833631d8fbac4f798e75e0acd31d627d 2023-11-21 13:55:18,219 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/8c0ab801c71b4268811d600415bb2ac7 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/8c0ab801c71b4268811d600415bb2ac7 2023-11-21 13:55:18,220 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/ba71260c9f2745e5bff68c68527fdd0a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/ba71260c9f2745e5bff68c68527fdd0a 2023-11-21 13:55:18,221 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/e962c1c218fe48ebb94ee26d01d635a0 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/e962c1c218fe48ebb94ee26d01d635a0 2023-11-21 13:55:18,237 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311212be937fb153a4c178f13f771334651b9_del 2023-11-21 13:55:18,237 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311212be937fb153a4c178f13f771334651b9_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311212be937fb153a4c178f13f771334651b9_del 2023-11-21 13:55:18,673 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 12bd5efc9506474f902aeff53db582da 2023-11-21 13:55:18,674 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family2/12bd5efc9506474f902aeff53db582da as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/12bd5efc9506474f902aeff53db582da 2023-11-21 13:55:18,678 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 12bd5efc9506474f902aeff53db582da 2023-11-21 13:55:18,679 INFO [Listener at localhost/35077] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a3726db2a6d35a4ace20911e14a84575/family2 of a3726db2a6d35a4ace20911e14a84575 into 12bd5efc9506474f902aeff53db582da(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:55:18,679 DEBUG [Listener at localhost/35077] regionserver.HRegion(2289): Compaction status journal for a3726db2a6d35a4ace20911e14a84575: 2023-11-21 13:55:18,679 DEBUG [Listener at localhost/35077] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:55:18,680 DEBUG [Listener at localhost/35077] regionserver.HStore(1912): 2c2220da91c79539696a8094984e331e/family1 is initiating major compaction (all files) 2023-11-21 13:55:18,680 INFO [Listener at localhost/35077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:55:18,680 INFO [Listener at localhost/35077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:55:18,680 INFO [Listener at localhost/35077] regionserver.HRegion(2259): Starting compaction of 2c2220da91c79539696a8094984e331e/family1 in testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:18,680 INFO [Listener at localhost/35077] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/625ff5eabac64bcd9f0e5ba027931c53, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cd9a918c980747cb955ab2f73dee69a6, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/08c9168407a946debf88df93938065a2, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cd97572f1e9141dc889c7492f46cece6, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/420f58716b094664ab403467c6800222] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp, totalSize=26.7 K 2023-11-21 13:55:18,681 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 625ff5eabac64bcd9f0e5ba027931c53, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574906718 2023-11-21 13:55:18,681 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting cd9a918c980747cb955ab2f73dee69a6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574908523 2023-11-21 13:55:18,683 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 08c9168407a946debf88df93938065a2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574909916 2023-11-21 13:55:18,683 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting cd97572f1e9141dc889c7492f46cece6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574911716 2023-11-21 13:55:18,685 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 420f58716b094664ab403467c6800222, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-21 13:55:18,703 INFO [Listener at localhost/35077] throttle.PressureAwareThroughputController(145): 2c2220da91c79539696a8094984e331e#family1#compaction#112 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:55:18,714 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311218a46ccda1edc475e8cdac23d16ed5b0f_del 2023-11-21 13:55:18,715 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311218a46ccda1edc475e8cdac23d16ed5b0f_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311218a46ccda1edc475e8cdac23d16ed5b0f_del 2023-11-21 13:55:18,716 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/7cacaaa69f874133add2611b3499950e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/fe584384e451421e966c64b193ca6784, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/cc1e2abdb8b84b0a8e5b474cdb792e45, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/17d29f4adc654a13b4cada34bc7f4d31, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/badc53157b0a4a08801a9d520d181ecc] to archive 2023-11-21 13:55:18,716 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:18,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/7cacaaa69f874133add2611b3499950e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/7cacaaa69f874133add2611b3499950e 2023-11-21 13:55:18,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/fe584384e451421e966c64b193ca6784 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/fe584384e451421e966c64b193ca6784 2023-11-21 13:55:18,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/cc1e2abdb8b84b0a8e5b474cdb792e45 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/cc1e2abdb8b84b0a8e5b474cdb792e45 2023-11-21 13:55:18,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/17d29f4adc654a13b4cada34bc7f4d31 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/17d29f4adc654a13b4cada34bc7f4d31 2023-11-21 13:55:18,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/badc53157b0a4a08801a9d520d181ecc to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/badc53157b0a4a08801a9d520d181ecc 2023-11-21 13:55:18,735 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cdbe2ff0cec64d88a6c695a95e614178 2023-11-21 13:55:18,736 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family1/cdbe2ff0cec64d88a6c695a95e614178 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cdbe2ff0cec64d88a6c695a95e614178 2023-11-21 13:55:18,740 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cdbe2ff0cec64d88a6c695a95e614178 2023-11-21 13:55:18,741 INFO [Listener at localhost/35077] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2c2220da91c79539696a8094984e331e/family1 of 2c2220da91c79539696a8094984e331e into cdbe2ff0cec64d88a6c695a95e614178(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:55:18,741 DEBUG [Listener at localhost/35077] regionserver.HRegion(2289): Compaction status journal for 2c2220da91c79539696a8094984e331e: 2023-11-21 13:55:18,741 DEBUG [Listener at localhost/35077] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:55:18,741 DEBUG [Listener at localhost/35077] regionserver.HStore(1912): 2c2220da91c79539696a8094984e331e/family2 is initiating major compaction (all files) 2023-11-21 13:55:18,741 INFO [Listener at localhost/35077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:55:18,741 INFO [Listener at localhost/35077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:55:18,742 INFO [Listener at localhost/35077] regionserver.HRegion(2259): Starting compaction of 2c2220da91c79539696a8094984e331e/family2 in testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:18,742 INFO [Listener at localhost/35077] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/7669c129d1c947e2b93c80da48fe282d, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/9cefbb6708ea467c83688fd844c68bb7, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/8a0bfb9aaea443ce937260a1c1b4218b, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/7726f25dbada4e85a3299254e5fa012e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/4d91d02270de4ef19b41bba4e56b69b2] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp, totalSize=25.4 K 2023-11-21 13:55:18,743 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 7669c129d1c947e2b93c80da48fe282d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574906718 2023-11-21 13:55:18,743 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 9cefbb6708ea467c83688fd844c68bb7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574908523 2023-11-21 13:55:18,744 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 8a0bfb9aaea443ce937260a1c1b4218b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574909916 2023-11-21 13:55:18,744 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 7726f25dbada4e85a3299254e5fa012e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574911716 2023-11-21 13:55:18,744 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 4d91d02270de4ef19b41bba4e56b69b2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-21 13:55:18,756 INFO [Listener at localhost/35077] throttle.PressureAwareThroughputController(145): 2c2220da91c79539696a8094984e331e#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:55:18,767 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023112122af619e93da45c2ace80f28730a7d26_del 2023-11-21 13:55:18,767 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112122af619e93da45c2ace80f28730a7d26_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112122af619e93da45c2ace80f28730a7d26_del 2023-11-21 13:55:18,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/625ff5eabac64bcd9f0e5ba027931c53, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cd9a918c980747cb955ab2f73dee69a6, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/08c9168407a946debf88df93938065a2, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cd97572f1e9141dc889c7492f46cece6, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/420f58716b094664ab403467c6800222] to archive 2023-11-21 13:55:18,822 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:18,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/625ff5eabac64bcd9f0e5ba027931c53 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/625ff5eabac64bcd9f0e5ba027931c53 2023-11-21 13:55:18,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cd9a918c980747cb955ab2f73dee69a6 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cd9a918c980747cb955ab2f73dee69a6 2023-11-21 13:55:18,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/08c9168407a946debf88df93938065a2 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/08c9168407a946debf88df93938065a2 2023-11-21 13:55:18,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cd97572f1e9141dc889c7492f46cece6 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cd97572f1e9141dc889c7492f46cece6 2023-11-21 13:55:18,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/420f58716b094664ab403467c6800222 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/420f58716b094664ab403467c6800222 2023-11-21 13:55:18,855 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-21 13:55:19,185 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 07c5782591004b4f96afe6a4a37ec7dd 2023-11-21 13:55:19,186 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family2/07c5782591004b4f96afe6a4a37ec7dd as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/07c5782591004b4f96afe6a4a37ec7dd 2023-11-21 13:55:19,190 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 07c5782591004b4f96afe6a4a37ec7dd 2023-11-21 13:55:19,191 INFO [Listener at localhost/35077] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2c2220da91c79539696a8094984e331e/family2 of 2c2220da91c79539696a8094984e331e into 07c5782591004b4f96afe6a4a37ec7dd(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:55:19,191 DEBUG [Listener at localhost/35077] regionserver.HRegion(2289): Compaction status journal for 2c2220da91c79539696a8094984e331e: 2023-11-21 13:55:19,200 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:55:19,205 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:55:19,214 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:55:19,216 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:55:19,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/7669c129d1c947e2b93c80da48fe282d, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/9cefbb6708ea467c83688fd844c68bb7, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/8a0bfb9aaea443ce937260a1c1b4218b, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/7726f25dbada4e85a3299254e5fa012e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/4d91d02270de4ef19b41bba4e56b69b2] to archive 2023-11-21 13:55:19,224 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:19,233 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/7669c129d1c947e2b93c80da48fe282d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/7669c129d1c947e2b93c80da48fe282d 2023-11-21 13:55:19,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/9cefbb6708ea467c83688fd844c68bb7 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/9cefbb6708ea467c83688fd844c68bb7 2023-11-21 13:55:19,236 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/8a0bfb9aaea443ce937260a1c1b4218b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/8a0bfb9aaea443ce937260a1c1b4218b 2023-11-21 13:55:19,237 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/7726f25dbada4e85a3299254e5fa012e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/7726f25dbada4e85a3299254e5fa012e 2023-11-21 13:55:19,238 INFO [Listener at localhost/35077] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-21 13:55:19,239 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/4d91d02270de4ef19b41bba4e56b69b2 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/4d91d02270de4ef19b41bba4e56b69b2 2023-11-21 13:55:19,288 INFO [Listener at localhost/35077] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-21 13:55:19,292 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311218a46ccda1edc475e8cdac23d16ed5b0f_del 2023-11-21 13:55:19,296 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311217d799a23259a46eaa8c779e007e9221b_del 2023-11-21 13:55:19,300 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311213e07cfb08b7c4767979d777ae626cfd1_del 2023-11-21 13:55:19,300 INFO [Listener at localhost/35077] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-21 13:55:19,301 DEBUG [Listener at localhost/35077] zookeeper.ReadOnlyZKClient(139): Connect 0x0988f79d to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:55:19,315 DEBUG [Listener at localhost/35077] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c4f4a6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:55:19,316 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231121 for table='testCompactionWithHFileLink' and column='family1' 2023-11-21 13:55:19,316 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231121 for table='testCompactionWithHFileLink' and column='family1' 2023-11-21 13:55:19,316 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231121 for table='testCompactionWithHFileLink' and column='family1' 2023-11-21 13:55:19,440 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311214dc35f5a891c4b989d661d9cbb621372 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311214dc35f5a891c4b989d661d9cbb621372 2023-11-21 13:55:19,441 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231121 table='testCompactionWithHFileLink' column='family1' 2023-11-21 13:55:19,442 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231121aac335e14a454d0882ce61c5e2f3d374 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231121aac335e14a454d0882ce61c5e2f3d374 2023-11-21 13:55:19,444 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231121 table='testCompactionWithHFileLink' column='family1' 2023-11-21 13:55:19,457 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:55:19,460 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:44318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:55:19,467 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-21 13:55:19,470 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:48512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-21 13:55:19,481 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231121/family1/27bd036956884951b2c32a067b432298 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-21 13:55:19,481 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231121/family1/732484d014cc4f4bb0938b90df8b1950 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-21 13:55:19,483 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231121/family1/27bd036956884951b2c32a067b432298}] 2023-11-21 13:55:19,483 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231121/family1/732484d014cc4f4bb0938b90df8b1950}] 2023-11-21 13:55:19,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231121/family1/732484d014cc4f4bb0938b90df8b1950 for inclusion in a3726db2a6d35a4ace20911e14a84575/family1 2023-11-21 13:55:19,488 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231121/family1/27bd036956884951b2c32a067b432298 for inclusion in 2c2220da91c79539696a8094984e331e/family1 2023-11-21 13:55:19,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-21 13:55:19,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-21 13:55:19,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-21 13:55:19,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last=1 2023-11-21 13:55:19,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for a3726db2a6d35a4ace20911e14a84575: 2023-11-21 13:55:19,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 2c2220da91c79539696a8094984e331e: 2023-11-21 13:55:19,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231121/family1/732484d014cc4f4bb0938b90df8b1950 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__b6ottcumdu1fd1kojam2vu9jboe3ukcu0ikdrdmskacpl2vmbr8f5idb4n3vu6nq/family1/732484d014cc4f4bb0938b90df8b1950 2023-11-21 13:55:19,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231121/family1/27bd036956884951b2c32a067b432298 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__rvhsq9f5naotvped1oahaojjtva8parn6vjcaabt62f0975f6i6d79r4obu9h6ke/family1/27bd036956884951b2c32a067b432298 2023-11-21 13:55:19,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__b6ottcumdu1fd1kojam2vu9jboe3ukcu0ikdrdmskacpl2vmbr8f5idb4n3vu6nq/family1/732484d014cc4f4bb0938b90df8b1950 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/6da309008af54454b3e56fb8b5233422_SeqId_29_ 2023-11-21 13:55:19,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__rvhsq9f5naotvped1oahaojjtva8parn6vjcaabt62f0975f6i6d79r4obu9h6ke/family1/27bd036956884951b2c32a067b432298 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/3b594b8428ac419e8cac6020dc695394_SeqId_29_ 2023-11-21 13:55:19,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__b6ottcumdu1fd1kojam2vu9jboe3ukcu0ikdrdmskacpl2vmbr8f5idb4n3vu6nq/family1/732484d014cc4f4bb0938b90df8b1950 into a3726db2a6d35a4ace20911e14a84575/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/6da309008af54454b3e56fb8b5233422_SeqId_29_ - updating store file list. 2023-11-21 13:55:19,494 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__rvhsq9f5naotvped1oahaojjtva8parn6vjcaabt62f0975f6i6d79r4obu9h6ke/family1/27bd036956884951b2c32a067b432298 into 2c2220da91c79539696a8094984e331e/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/3b594b8428ac419e8cac6020dc695394_SeqId_29_ - updating store file list. 2023-11-21 13:55:19,504 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/3b594b8428ac419e8cac6020dc695394_SeqId_29_ into 2c2220da91c79539696a8094984e331e/family1 2023-11-21 13:55:19,504 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__rvhsq9f5naotvped1oahaojjtva8parn6vjcaabt62f0975f6i6d79r4obu9h6ke/family1/27bd036956884951b2c32a067b432298 into 2c2220da91c79539696a8094984e331e/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/3b594b8428ac419e8cac6020dc695394_SeqId_29_) 2023-11-21 13:55:19,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__rvhsq9f5naotvped1oahaojjtva8parn6vjcaabt62f0975f6i6d79r4obu9h6ke/family1/27bd036956884951b2c32a067b432298 2023-11-21 13:55:19,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/6da309008af54454b3e56fb8b5233422_SeqId_29_ into a3726db2a6d35a4ace20911e14a84575/family1 2023-11-21 13:55:19,511 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231121 table='testCompactionWithHFileLink' column='family1' 2023-11-21 13:55:19,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__b6ottcumdu1fd1kojam2vu9jboe3ukcu0ikdrdmskacpl2vmbr8f5idb4n3vu6nq/family1/732484d014cc4f4bb0938b90df8b1950 into a3726db2a6d35a4ace20911e14a84575/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/6da309008af54454b3e56fb8b5233422_SeqId_29_) 2023-11-21 13:55:19,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__b6ottcumdu1fd1kojam2vu9jboe3ukcu0ikdrdmskacpl2vmbr8f5idb4n3vu6nq/family1/732484d014cc4f4bb0938b90df8b1950 2023-11-21 13:55:19,512 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:19,514 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231121 table='testCompactionWithHFileLink' column='family1' 2023-11-21 13:55:19,514 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311210fa8109b150d464882a6f44b66b5d449 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311210fa8109b150d464882a6f44b66b5d449 2023-11-21 13:55:19,514 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:19,515 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112181ef61da86b84d23ae5aeafb54c77cea to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112181ef61da86b84d23ae5aeafb54c77cea 2023-11-21 13:55:19,516 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121477c593f302a4ebb8e41d1f4bc2d3465 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121477c593f302a4ebb8e41d1f4bc2d3465 2023-11-21 13:55:19,517 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311219416ad37fc114e388efa2d0add8e46e8 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311219416ad37fc114e388efa2d0add8e46e8 2023-11-21 13:55:19,517 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121481ced72e8634a0e8e51921117a1da00 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121481ced72e8634a0e8e51921117a1da00 2023-11-21 13:55:19,518 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231121ec7e5d4ccdd649ea9c5552974861856b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231121ec7e5d4ccdd649ea9c5552974861856b 2023-11-21 13:55:19,518 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-21 13:55:19,518 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231121' 2023-11-21 13:55:19,518 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121b619ba38965f4976843c9f63139f217a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121b619ba38965f4976843c9f63139f217a 2023-11-21 13:55:19,518 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231121 for table='testCompactionWithHFileLink' and column='family1' 2023-11-21 13:55:19,519 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121d370efe300e447308cc51bb4e12ae2ab to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121d370efe300e447308cc51bb4e12ae2ab 2023-11-21 13:55:19,519 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-21 13:55:19,519 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231121' 2023-11-21 13:55:19,520 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231121 for table='testCompactionWithHFileLink' and column='family1' 2023-11-21 13:55:19,855 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311217eef092653f1418283c8bddf5acded8f to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311217eef092653f1418283c8bddf5acded8f 2023-11-21 13:55:19,856 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231121 table='testCompactionWithHFileLink' column='family1' 2023-11-21 13:55:19,890 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231121/family1/1226abf1396e42309ec1096bbde49a04 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-21 13:55:19,890 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231121/family1/1226abf1396e42309ec1096bbde49a04}] 2023-11-21 13:55:19,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231121/family1/1226abf1396e42309ec1096bbde49a04 for inclusion in 489c1aeed0cfc5efd1e74cd4f52c14b7/family1 2023-11-21 13:55:19,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-21 13:55:19,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-21 13:55:19,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 489c1aeed0cfc5efd1e74cd4f52c14b7: 2023-11-21 13:55:19,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231121/family1/1226abf1396e42309ec1096bbde49a04 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__p6faoni990bregofcnj0n1vipa957psaj61tr7ab68g3a3rl4pit15bgb7kalfse/family1/1226abf1396e42309ec1096bbde49a04 2023-11-21 13:55:19,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__p6faoni990bregofcnj0n1vipa957psaj61tr7ab68g3a3rl4pit15bgb7kalfse/family1/1226abf1396e42309ec1096bbde49a04 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/3c9e8968f9e442f18d223ba59213070d_SeqId_29_ 2023-11-21 13:55:19,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__p6faoni990bregofcnj0n1vipa957psaj61tr7ab68g3a3rl4pit15bgb7kalfse/family1/1226abf1396e42309ec1096bbde49a04 into 489c1aeed0cfc5efd1e74cd4f52c14b7/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/3c9e8968f9e442f18d223ba59213070d_SeqId_29_ - updating store file list. 2023-11-21 13:55:19,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/3c9e8968f9e442f18d223ba59213070d_SeqId_29_ into 489c1aeed0cfc5efd1e74cd4f52c14b7/family1 2023-11-21 13:55:19,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__p6faoni990bregofcnj0n1vipa957psaj61tr7ab68g3a3rl4pit15bgb7kalfse/family1/1226abf1396e42309ec1096bbde49a04 into 489c1aeed0cfc5efd1e74cd4f52c14b7/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/3c9e8968f9e442f18d223ba59213070d_SeqId_29_) 2023-11-21 13:55:19,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__p6faoni990bregofcnj0n1vipa957psaj61tr7ab68g3a3rl4pit15bgb7kalfse/family1/1226abf1396e42309ec1096bbde49a04 2023-11-21 13:55:19,905 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231121 table='testCompactionWithHFileLink' column='family1' 2023-11-21 13:55:19,906 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:19,907 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121b2f42049d02a4b37a43e96962c985b9e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121b2f42049d02a4b37a43e96962c985b9e 2023-11-21 13:55:19,908 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121f8a34cc10a484ecba803bde3af1ea1bf to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121f8a34cc10a484ecba803bde3af1ea1bf 2023-11-21 13:55:19,909 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121fdc3a9147e0b46dc9d057989571b4a9a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121fdc3a9147e0b46dc9d057989571b4a9a 2023-11-21 13:55:19,910 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121ffd1c159ecbf4349af9e328e2916bd4c to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231121ffd1c159ecbf4349af9e328e2916bd4c 2023-11-21 13:55:19,910 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-21 13:55:19,910 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231121' 2023-11-21 13:55:19,910 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231121 for table='testCompactionWithHFileLink' and column='family1' 2023-11-21 13:55:19,910 INFO [Listener at localhost/35077] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-21 13:55:19,911 INFO [Listener at localhost/35077] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-21 13:55:19,911 INFO [Listener at localhost/35077] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311218a46ccda1edc475e8cdac23d16ed5b0f_del] 2023-11-21 13:55:19,911 DEBUG [Listener at localhost/35077] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:19,912 DEBUG [Listener at localhost/35077] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311218a46ccda1edc475e8cdac23d16ed5b0f_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311218a46ccda1edc475e8cdac23d16ed5b0f_del 2023-11-21 13:55:19,912 INFO [Listener at localhost/35077] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-21 13:55:19,912 INFO [Listener at localhost/35077] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311217d799a23259a46eaa8c779e007e9221b_del] 2023-11-21 13:55:19,913 DEBUG [Listener at localhost/35077] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:19,914 DEBUG [Listener at localhost/35077] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311217d799a23259a46eaa8c779e007e9221b_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311217d799a23259a46eaa8c779e007e9221b_del 2023-11-21 13:55:19,914 INFO [Listener at localhost/35077] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-21 13:55:19,914 INFO [Listener at localhost/35077] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311213e07cfb08b7c4767979d777ae626cfd1_del] 2023-11-21 13:55:19,915 DEBUG [Listener at localhost/35077] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:19,916 DEBUG [Listener at localhost/35077] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311213e07cfb08b7c4767979d777ae626cfd1_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311213e07cfb08b7c4767979d777ae626cfd1_del 2023-11-21 13:55:19,916 INFO [Listener at localhost/35077] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-21 13:55:19,919 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:55:19,920 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:55:19,923 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:55:19,924 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:55:19,931 INFO [Listener at localhost/35077] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-21 13:55:19,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$11(2418): Client=jenkins//172.31.2.20 disable testCompactionWithHFileLink 2023-11-21 13:55:19,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-21 13:55:19,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-21 13:55:19,934 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574919934"}]},"ts":"1700574919934"} 2023-11-21 13:55:19,936 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-21 13:55:19,937 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-21 13:55:19,938 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2c2220da91c79539696a8094984e331e, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=489c1aeed0cfc5efd1e74cd4f52c14b7, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a3726db2a6d35a4ace20911e14a84575, UNASSIGN}] 2023-11-21 13:55:19,939 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=489c1aeed0cfc5efd1e74cd4f52c14b7, UNASSIGN 2023-11-21 13:55:19,939 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2c2220da91c79539696a8094984e331e, UNASSIGN 2023-11-21 13:55:19,940 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a3726db2a6d35a4ace20911e14a84575, UNASSIGN 2023-11-21 13:55:19,940 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=489c1aeed0cfc5efd1e74cd4f52c14b7, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:19,940 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=2c2220da91c79539696a8094984e331e, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:19,940 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700574919940"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574919940"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574919940"}]},"ts":"1700574919940"} 2023-11-21 13:55:19,940 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=a3726db2a6d35a4ace20911e14a84575, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:19,940 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700574919940"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574919940"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574919940"}]},"ts":"1700574919940"} 2023-11-21 13:55:19,940 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700574919940"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574919940"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574919940"}]},"ts":"1700574919940"} 2023-11-21 13:55:19,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 489c1aeed0cfc5efd1e74cd4f52c14b7, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:19,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 2c2220da91c79539696a8094984e331e, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:19,943 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure a3726db2a6d35a4ace20911e14a84575, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:20,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-21 13:55:20,093 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:20,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close 489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:20,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 489c1aeed0cfc5efd1e74cd4f52c14b7, disabling compactions & flushes 2023-11-21 13:55:20,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:20,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:20,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. after waiting 0 ms 2023-11-21 13:55:20,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:20,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-21 13:55:20,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:20,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 489c1aeed0cfc5efd1e74cd4f52c14b7: 2023-11-21 13:55:20,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed 489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:20,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close 2c2220da91c79539696a8094984e331e 2023-11-21 13:55:20,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 2c2220da91c79539696a8094984e331e, disabling compactions & flushes 2023-11-21 13:55:20,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:20,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:20,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. after waiting 0 ms 2023-11-21 13:55:20,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:20,101 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=489c1aeed0cfc5efd1e74cd4f52c14b7, regionState=CLOSED 2023-11-21 13:55:20,101 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700574920101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574920101"}]},"ts":"1700574920101"} 2023-11-21 13:55:20,104 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=92, resume processing ppid=90 2023-11-21 13:55:20,104 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure 489c1aeed0cfc5efd1e74cd4f52c14b7, server=jenkins-hbase6.apache.org,46365,1700574804408 in 161 msec 2023-11-21 13:55:20,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-21 13:55:20,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:20,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 2c2220da91c79539696a8094984e331e: 2023-11-21 13:55:20,105 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=489c1aeed0cfc5efd1e74cd4f52c14b7, UNASSIGN in 166 msec 2023-11-21 13:55:20,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed 2c2220da91c79539696a8094984e331e 2023-11-21 13:55:20,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:20,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing a3726db2a6d35a4ace20911e14a84575, disabling compactions & flushes 2023-11-21 13:55:20,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:20,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:20,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. after waiting 0 ms 2023-11-21 13:55:20,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:20,107 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=2c2220da91c79539696a8094984e331e, regionState=CLOSED 2023-11-21 13:55:20,107 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700574920107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574920107"}]},"ts":"1700574920107"} 2023-11-21 13:55:20,109 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=93, resume processing ppid=89 2023-11-21 13:55:20,110 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure 2c2220da91c79539696a8094984e331e, server=jenkins-hbase6.apache.org,46365,1700574804408 in 166 msec 2023-11-21 13:55:20,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-21 13:55:20,111 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2c2220da91c79539696a8094984e331e, UNASSIGN in 172 msec 2023-11-21 13:55:20,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:20,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for a3726db2a6d35a4ace20911e14a84575: 2023-11-21 13:55:20,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:20,112 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=a3726db2a6d35a4ace20911e14a84575, regionState=CLOSED 2023-11-21 13:55:20,113 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700574920112"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574920112"}]},"ts":"1700574920112"} 2023-11-21 13:55:20,115 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=94, resume processing ppid=91 2023-11-21 13:55:20,115 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure a3726db2a6d35a4ace20911e14a84575, server=jenkins-hbase6.apache.org,46365,1700574804408 in 172 msec 2023-11-21 13:55:20,116 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=91, resume processing ppid=88 2023-11-21 13:55:20,116 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a3726db2a6d35a4ace20911e14a84575, UNASSIGN in 177 msec 2023-11-21 13:55:20,116 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574920116"}]},"ts":"1700574920116"} 2023-11-21 13:55:20,117 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-21 13:55:20,120 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-21 13:55:20,121 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 189 msec 2023-11-21 13:55:20,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-21 13:55:20,237 INFO [Listener at localhost/35077] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-21 13:55:20,248 INFO [Listener at localhost/35077] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1700574913551-1700574920248 2023-11-21 13:55:20,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1583): Client=jenkins//172.31.2.20 snapshot request for:{ ss=hbase-failsafe-snaptb-1700574913551-1700574920248 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-21 13:55:20,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1700574920248 (current time:1700574920248). 2023-11-21 13:55:20,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-21 13:55:20,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] zookeeper.ReadOnlyZKClient(139): Connect 0x3415cc65 to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:55:20,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b1611b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:55:20,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:55:20,257 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:60858, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:55:20,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3415cc65 to 127.0.0.1:52369 2023-11-21 13:55:20,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:55:20,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-21 13:55:20,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1700574913551-1700574920248 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-21 13:55:20,261 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.hbase-snapshot, current working dir path: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700574913551-1700574920248 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-21 13:55:20,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-21 13:55:20,263 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-21 13:55:20,264 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1700575520264 2023-11-21 13:55:20,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1700574913551-1700574920248 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-21 13:55:20,264 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1700574913551-1700574920248 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-21 13:55:20,264 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1700574913551-1700574920248 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:20,264 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-21 13:55:20,364 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-21 13:55:20,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700574913551-1700574920248 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-21 13:55:20,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700574913551-1700574920248 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-21 13:55:20,366 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-21 13:55:20,566 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-21 13:55:20,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700574913551-1700574920248 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-21 13:55:20,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700574913551-1700574920248 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-21 13:55:20,567 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-21 13:55:20,671 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1700574913551-1700574920248 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-21 13:55:20,673 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-21 13:55:20,673 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-21 13:55:20,673 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-21 13:55:20,673 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-21 13:55:20,673 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-21 13:55:20,673 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-21 13:55:20,673 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-21 13:55:20,673 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-21 13:55:20,676 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/6da309008af54454b3e56fb8b5233422_SeqId_29_, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/c66b739149a7453f974911c279d28d76] hfiles 2023-11-21 13:55:20,676 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/6da309008af54454b3e56fb8b5233422_SeqId_29_ 2023-11-21 13:55:20,676 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/c66b739149a7453f974911c279d28d76 2023-11-21 13:55:20,676 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/3c9e8968f9e442f18d223ba59213070d_SeqId_29_, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/4e8ed4eb270f43a582c8025ea42181e9] hfiles 2023-11-21 13:55:20,676 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/3c9e8968f9e442f18d223ba59213070d_SeqId_29_ 2023-11-21 13:55:20,676 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/4e8ed4eb270f43a582c8025ea42181e9 2023-11-21 13:55:20,677 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/3b594b8428ac419e8cac6020dc695394_SeqId_29_, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cdbe2ff0cec64d88a6c695a95e614178] hfiles 2023-11-21 13:55:20,677 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/3b594b8428ac419e8cac6020dc695394_SeqId_29_ 2023-11-21 13:55:20,677 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cdbe2ff0cec64d88a6c695a95e614178 2023-11-21 13:55:20,677 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311217eef092653f1418283c8bddf5acded8f, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311214dc35f5a891c4b989d661d9cbb621372, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231121aac335e14a454d0882ce61c5e2f3d374] hfiles 2023-11-21 13:55:20,677 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/12bd5efc9506474f902aeff53db582da] hfiles 2023-11-21 13:55:20,677 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311217eef092653f1418283c8bddf5acded8f 2023-11-21 13:55:20,677 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/12bd5efc9506474f902aeff53db582da 2023-11-21 13:55:20,677 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311214dc35f5a891c4b989d661d9cbb621372 2023-11-21 13:55:20,677 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231121aac335e14a454d0882ce61c5e2f3d374 2023-11-21 13:55:20,677 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/c299d89bf6924d138cb218e4919e589b] hfiles 2023-11-21 13:55:20,677 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/c299d89bf6924d138cb218e4919e589b 2023-11-21 13:55:20,677 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/07c5782591004b4f96afe6a4a37ec7dd] hfiles 2023-11-21 13:55:20,677 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/07c5782591004b4f96afe6a4a37ec7dd 2023-11-21 13:55:20,687 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311216923139c965840299e665c44b6cb98c9, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121943d9378e03a4e6eb6f9a7bbbb2a8476_del, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121ca194cb70123480db75873be04d66098, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121cb012e713e4e4ab292ed072251cea2db, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121d136640b5a6b41af9d5de66c82e37e14, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311212be937fb153a4c178f13f771334651b9_del, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311213096bec9232e4605b68cfba4e678a0ee, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311216cab875f93aa4edcbbc273f9347170e4, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231121913e3e229c234fee9459e2d35af96173, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231121e1bd2d3eb39d4852ae82bc3d046cef8a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112122af619e93da45c2ace80f28730a7d26_del, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311216ef3b09479b54f35801ac968d027814e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231121766edc502d624c0bade967778f48e606, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311218fed1aa0338342c0a4afa0b9e0a9556e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231121dc2b6625d69342f58bc7d49093db58b1] hfiles 2023-11-21 13:55:20,687 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311216923139c965840299e665c44b6cb98c9 2023-11-21 13:55:20,687 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121943d9378e03a4e6eb6f9a7bbbb2a8476_del 2023-11-21 13:55:20,687 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121ca194cb70123480db75873be04d66098 2023-11-21 13:55:20,687 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121cb012e713e4e4ab292ed072251cea2db 2023-11-21 13:55:20,687 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121d136640b5a6b41af9d5de66c82e37e14 2023-11-21 13:55:20,688 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311212be937fb153a4c178f13f771334651b9_del 2023-11-21 13:55:20,688 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311213096bec9232e4605b68cfba4e678a0ee 2023-11-21 13:55:20,688 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311216cab875f93aa4edcbbc273f9347170e4 2023-11-21 13:55:20,688 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231121913e3e229c234fee9459e2d35af96173 2023-11-21 13:55:20,688 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231121e1bd2d3eb39d4852ae82bc3d046cef8a 2023-11-21 13:55:20,688 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112122af619e93da45c2ace80f28730a7d26_del 2023-11-21 13:55:20,688 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311216ef3b09479b54f35801ac968d027814e 2023-11-21 13:55:20,688 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231121766edc502d624c0bade967778f48e606 2023-11-21 13:55:20,688 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311218fed1aa0338342c0a4afa0b9e0a9556e 2023-11-21 13:55:20,688 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231121dc2b6625d69342f58bc7d49093db58b1 2023-11-21 13:55:20,868 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-21 13:55:20,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700574913551-1700574920248 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-21 13:55:20,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700574913551-1700574920248 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-21 13:55:20,869 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-21 13:55:21,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1700574913551-1700574920248 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-21 13:55:21,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1700574913551-1700574920248 2023-11-21 13:55:21,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700574913551-1700574920248 2023-11-21 13:55:21,369 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-21 13:55:21,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700574913551-1700574920248 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-21 13:55:21,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700574913551-1700574920248 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-21 13:55:21,370 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-21 13:55:21,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700574913551-1700574920248 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.hbase-snapshot/hbase-failsafe-snaptb-1700574913551-1700574920248 2023-11-21 13:55:21,519 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1700574913551-1700574920248 of table testCompactionWithHFileLink completed 2023-11-21 13:55:21,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700574913551-1700574920248 2023-11-21 13:55:21,519 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700574913551-1700574920248 2023-11-21 13:55:21,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1700574913551-1700574920248 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1700574920264Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1700574913551-1700574920248 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1700574920671 (+407 ms)Consolidate snapshot: hbase-failsafe-snaptb-1700574913551-1700574920248 at 1700574921093 (+422 ms)Loading Region manifests for hbase-failsafe-snaptb-1700574913551-1700574920248 at 1700574921093Writing data manifest for hbase-failsafe-snaptb-1700574913551-1700574920248 at 1700574921097 (+4 ms)Verifying snapshot: hbase-failsafe-snaptb-1700574913551-1700574920248 at 1700574921503 (+406 ms)Snapshot hbase-failsafe-snaptb-1700574913551-1700574920248 of table testCompactionWithHFileLink completed at 1700574921519 (+16 ms) 2023-11-21 13:55:21,520 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-21 13:55:21,522 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2580 sec 2023-11-21 13:55:22,371 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-21 13:55:22,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700574913551-1700574920248 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-21 13:55:22,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1700574913551-1700574920248 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-21 13:55:22,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1700574913551" table: "testCompactionWithHFileLink" creation_time: 1700574913562 type: FLUSH version: 2 ttl: 0 ) 2023-11-21 13:55:22,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1700574913551 as table=testCompactionWithHFileLink 2023-11-21 13:55:22,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-21 13:55:22,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-21 13:55:22,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-21 13:55:22,827 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-21 13:55:22,828 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-21 13:55:22,828 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-21 13:55:22,829 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1700574913551 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-21 13:55:22,834 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1700574913551" table: "testCompactionWithHFileLink" creation_time: 1700574913562 type: FLUSH version: 2 ttl: 0 2023-11-21 13:55:22,834 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink 2023-11-21 13:55:22,840 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-21 13:55:22,843 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311217eef092653f1418283c8bddf5acded8f to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311217eef092653f1418283c8bddf5acded8f 2023-11-21 13:55:22,844 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311214dc35f5a891c4b989d661d9cbb621372 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311214dc35f5a891c4b989d661d9cbb621372 2023-11-21 13:55:22,846 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231121aac335e14a454d0882ce61c5e2f3d374 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231121aac335e14a454d0882ce61c5e2f3d374 2023-11-21 13:55:22,846 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231121b2f42049d02a4b37a43e96962c985b9e of snapshot=snaptb-1700574913551 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-21 13:55:22,849 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231121f8a34cc10a484ecba803bde3af1ea1bf of snapshot=snaptb-1700574913551 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-21 13:55:22,852 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231121fdc3a9147e0b46dc9d057989571b4a9a of snapshot=snaptb-1700574913551 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-21 13:55:22,855 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231121ffd1c159ecbf4349af9e328e2916bd4c of snapshot=snaptb-1700574913551 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-21 13:55:22,858 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231121477c593f302a4ebb8e41d1f4bc2d3465 of snapshot=snaptb-1700574913551 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-21 13:55:22,861 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231121481ced72e8634a0e8e51921117a1da00 of snapshot=snaptb-1700574913551 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-21 13:55:22,864 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231121b619ba38965f4976843c9f63139f217a of snapshot=snaptb-1700574913551 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-21 13:55:22,867 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231121d370efe300e447308cc51bb4e12ae2ab of snapshot=snaptb-1700574913551 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-21 13:55:22,870 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311210fa8109b150d464882a6f44b66b5d449 of snapshot=snaptb-1700574913551 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-21 13:55:22,873 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023112181ef61da86b84d23ae5aeafb54c77cea of snapshot=snaptb-1700574913551 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-21 13:55:22,875 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311219416ad37fc114e388efa2d0add8e46e8 of snapshot=snaptb-1700574913551 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-21 13:55:22,878 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231121ec7e5d4ccdd649ea9c5552974861856b of snapshot=snaptb-1700574913551 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-21 13:55:22,883 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112122af619e93da45c2ace80f28730a7d26_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112122af619e93da45c2ace80f28730a7d26_del 2023-11-21 13:55:22,884 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121943d9378e03a4e6eb6f9a7bbbb2a8476_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231121943d9378e03a4e6eb6f9a7bbbb2a8476_del 2023-11-21 13:55:22,885 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311212be937fb153a4c178f13f771334651b9_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311212be937fb153a4c178f13f771334651b9_del 2023-11-21 13:55:22,885 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 2c2220da91c79539696a8094984e331e 2023-11-21 13:55:22,885 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:22,886 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:22,889 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/3b594b8428ac419e8cac6020dc695394_SeqId_29_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/3b594b8428ac419e8cac6020dc695394_SeqId_29_ 2023-11-21 13:55:22,889 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/6da309008af54454b3e56fb8b5233422_SeqId_29_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/6da309008af54454b3e56fb8b5233422_SeqId_29_ 2023-11-21 13:55:22,889 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/3c9e8968f9e442f18d223ba59213070d_SeqId_29_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/3c9e8968f9e442f18d223ba59213070d_SeqId_29_ 2023-11-21 13:55:22,891 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cdbe2ff0cec64d88a6c695a95e614178 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/cdbe2ff0cec64d88a6c695a95e614178 2023-11-21 13:55:22,891 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 625ff5eabac64bcd9f0e5ba027931c53 of snapshot=snaptb-1700574913551 to region=2c2220da91c79539696a8094984e331e table=testCompactionWithHFileLink 2023-11-21 13:55:22,891 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/c66b739149a7453f974911c279d28d76 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/c66b739149a7453f974911c279d28d76 2023-11-21 13:55:22,891 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/4e8ed4eb270f43a582c8025ea42181e9 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/4e8ed4eb270f43a582c8025ea42181e9 2023-11-21 13:55:22,891 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 06b3d411f57145f99e7bb0ad83ecbcb8 of snapshot=snaptb-1700574913551 to region=a3726db2a6d35a4ace20911e14a84575 table=testCompactionWithHFileLink 2023-11-21 13:55:22,891 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2d7339555d73468f8a547deac0e4da1f of snapshot=snaptb-1700574913551 to region=489c1aeed0cfc5efd1e74cd4f52c14b7 table=testCompactionWithHFileLink 2023-11-21 13:55:22,895 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cd9a918c980747cb955ab2f73dee69a6 of snapshot=snaptb-1700574913551 to region=2c2220da91c79539696a8094984e331e table=testCompactionWithHFileLink 2023-11-21 13:55:22,895 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5ac3b165f9eb4dcf896fc3fc1071be28 of snapshot=snaptb-1700574913551 to region=489c1aeed0cfc5efd1e74cd4f52c14b7 table=testCompactionWithHFileLink 2023-11-21 13:55:22,895 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 833631d8fbac4f798e75e0acd31d627d of snapshot=snaptb-1700574913551 to region=a3726db2a6d35a4ace20911e14a84575 table=testCompactionWithHFileLink 2023-11-21 13:55:22,900 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8c0ab801c71b4268811d600415bb2ac7 of snapshot=snaptb-1700574913551 to region=a3726db2a6d35a4ace20911e14a84575 table=testCompactionWithHFileLink 2023-11-21 13:55:22,901 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 08c9168407a946debf88df93938065a2 of snapshot=snaptb-1700574913551 to region=2c2220da91c79539696a8094984e331e table=testCompactionWithHFileLink 2023-11-21 13:55:22,901 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5d43ef103d274dc3a9bb93309c6608d8 of snapshot=snaptb-1700574913551 to region=489c1aeed0cfc5efd1e74cd4f52c14b7 table=testCompactionWithHFileLink 2023-11-21 13:55:22,905 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ba71260c9f2745e5bff68c68527fdd0a of snapshot=snaptb-1700574913551 to region=a3726db2a6d35a4ace20911e14a84575 table=testCompactionWithHFileLink 2023-11-21 13:55:22,905 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 56443ee5aa1b4940986938fa8c027eea of snapshot=snaptb-1700574913551 to region=489c1aeed0cfc5efd1e74cd4f52c14b7 table=testCompactionWithHFileLink 2023-11-21 13:55:22,906 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cd97572f1e9141dc889c7492f46cece6 of snapshot=snaptb-1700574913551 to region=2c2220da91c79539696a8094984e331e table=testCompactionWithHFileLink 2023-11-21 13:55:22,910 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/12bd5efc9506474f902aeff53db582da to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/12bd5efc9506474f902aeff53db582da 2023-11-21 13:55:22,910 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7cacaaa69f874133add2611b3499950e of snapshot=snaptb-1700574913551 to region=a3726db2a6d35a4ace20911e14a84575 table=testCompactionWithHFileLink 2023-11-21 13:55:22,910 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/c299d89bf6924d138cb218e4919e589b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/c299d89bf6924d138cb218e4919e589b 2023-11-21 13:55:22,910 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2813c6537fff4fc5970e0d660f5a3b9a of snapshot=snaptb-1700574913551 to region=489c1aeed0cfc5efd1e74cd4f52c14b7 table=testCompactionWithHFileLink 2023-11-21 13:55:22,912 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/07c5782591004b4f96afe6a4a37ec7dd to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/07c5782591004b4f96afe6a4a37ec7dd 2023-11-21 13:55:22,912 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7669c129d1c947e2b93c80da48fe282d of snapshot=snaptb-1700574913551 to region=2c2220da91c79539696a8094984e331e table=testCompactionWithHFileLink 2023-11-21 13:55:22,914 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fe584384e451421e966c64b193ca6784 of snapshot=snaptb-1700574913551 to region=a3726db2a6d35a4ace20911e14a84575 table=testCompactionWithHFileLink 2023-11-21 13:55:22,914 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5502cef6742140928005a8fc6f731c04 of snapshot=snaptb-1700574913551 to region=489c1aeed0cfc5efd1e74cd4f52c14b7 table=testCompactionWithHFileLink 2023-11-21 13:55:22,916 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9cefbb6708ea467c83688fd844c68bb7 of snapshot=snaptb-1700574913551 to region=2c2220da91c79539696a8094984e331e table=testCompactionWithHFileLink 2023-11-21 13:55:22,917 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cc1e2abdb8b84b0a8e5b474cdb792e45 of snapshot=snaptb-1700574913551 to region=a3726db2a6d35a4ace20911e14a84575 table=testCompactionWithHFileLink 2023-11-21 13:55:22,918 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7b31f03ff7ab433fb4c5ea94135b0d63 of snapshot=snaptb-1700574913551 to region=489c1aeed0cfc5efd1e74cd4f52c14b7 table=testCompactionWithHFileLink 2023-11-21 13:55:22,919 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8a0bfb9aaea443ce937260a1c1b4218b of snapshot=snaptb-1700574913551 to region=2c2220da91c79539696a8094984e331e table=testCompactionWithHFileLink 2023-11-21 13:55:22,921 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 17d29f4adc654a13b4cada34bc7f4d31 of snapshot=snaptb-1700574913551 to region=a3726db2a6d35a4ace20911e14a84575 table=testCompactionWithHFileLink 2023-11-21 13:55:22,921 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c1dc51a16a0c40feaaaafdc263319ddb of snapshot=snaptb-1700574913551 to region=489c1aeed0cfc5efd1e74cd4f52c14b7 table=testCompactionWithHFileLink 2023-11-21 13:55:22,923 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7726f25dbada4e85a3299254e5fa012e of snapshot=snaptb-1700574913551 to region=2c2220da91c79539696a8094984e331e table=testCompactionWithHFileLink 2023-11-21 13:55:22,926 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1700574913551" table: "testCompactionWithHFileLink" creation_time: 1700574913562 type: FLUSH version: 2 ttl: 0 2023-11-21 13:55:22,927 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700574922927"}]},"ts":"9223372036854775807"} 2023-11-21 13:55:22,927 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700574922927"}]},"ts":"9223372036854775807"} 2023-11-21 13:55:22,927 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700574922927"}]},"ts":"9223372036854775807"} 2023-11-21 13:55:22,929 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-21 13:55:22,929 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2c2220da91c79539696a8094984e331e, NAME => 'testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 489c1aeed0cfc5efd1e74cd4f52c14b7, NAME => 'testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => a3726db2a6d35a4ace20911e14a84575, NAME => 'testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575.', STARTKEY => '2', ENDKEY => ''}] 2023-11-21 13:55:22,929 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700574922928"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574922928"}]},"ts":"1700574922928"} 2023-11-21 13:55:22,929 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700574922928"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574922928"}]},"ts":"1700574922928"} 2023-11-21 13:55:22,929 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700574922928"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574922928"}]},"ts":"1700574922928"} 2023-11-21 13:55:22,931 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-21 13:55:22,931 INFO [PEWorker-2] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-21 13:55:22,931 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 2c2220da91c79539696a8094984e331e, NAME => 'testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 489c1aeed0cfc5efd1e74cd4f52c14b7, NAME => 'testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => a3726db2a6d35a4ace20911e14a84575, NAME => 'testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575.', STARTKEY => '2', ENDKEY => ''}] 2023-11-21 13:55:22,932 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1700574913551 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-21 13:55:22,933 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1700574913551" table: "testCompactionWithHFileLink" creation_time: 1700574913562 type: FLUSH version: 2 ttl: 0 ) in 524 msec 2023-11-21 13:55:23,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-21 13:55:23,023 INFO [Listener at localhost/35077] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-21 13:55:23,024 INFO [Listener at localhost/35077] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1700574913551-1700574920248 2023-11-21 13:55:23,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(751): Client=jenkins//172.31.2.20 delete name: "hbase-failsafe-snaptb-1700574913551-1700574920248" 2023-11-21 13:55:23,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1700574913551-1700574920248 2023-11-21 13:55:23,032 INFO [Listener at localhost/35077] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-21 13:55:23,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$10(2385): Client=jenkins//172.31.2.20 enable testCompactionWithHFileLink 2023-11-21 13:55:23,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-21 13:55:23,044 INFO [PEWorker-1] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-21 13:55:23,044 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574923044"}]},"ts":"1700574923044"} 2023-11-21 13:55:23,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-21 13:55:23,045 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-21 13:55:23,048 DEBUG [PEWorker-1] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-21 13:55:23,048 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2c2220da91c79539696a8094984e331e, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=489c1aeed0cfc5efd1e74cd4f52c14b7, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a3726db2a6d35a4ace20911e14a84575, ASSIGN}] 2023-11-21 13:55:23,049 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a3726db2a6d35a4ace20911e14a84575, ASSIGN 2023-11-21 13:55:23,049 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=489c1aeed0cfc5efd1e74cd4f52c14b7, ASSIGN 2023-11-21 13:55:23,049 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2c2220da91c79539696a8094984e331e, ASSIGN 2023-11-21 13:55:23,050 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a3726db2a6d35a4ace20911e14a84575, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-21 13:55:23,050 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2c2220da91c79539696a8094984e331e, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-21 13:55:23,050 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=489c1aeed0cfc5efd1e74cd4f52c14b7, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-21 13:55:23,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-21 13:55:23,202 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=a3726db2a6d35a4ace20911e14a84575, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:23,202 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=489c1aeed0cfc5efd1e74cd4f52c14b7, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:23,202 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=2c2220da91c79539696a8094984e331e, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:23,202 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700574923202"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574923202"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574923202"}]},"ts":"1700574923202"} 2023-11-21 13:55:23,202 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700574923202"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574923202"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574923202"}]},"ts":"1700574923202"} 2023-11-21 13:55:23,202 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700574923202"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574923202"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574923202"}]},"ts":"1700574923202"} 2023-11-21 13:55:23,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure a3726db2a6d35a4ace20911e14a84575, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:23,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure 489c1aeed0cfc5efd1e74cd4f52c14b7, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:23,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure 2c2220da91c79539696a8094984e331e, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:23,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-21 13:55:23,355 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:23,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:23,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 489c1aeed0cfc5efd1e74cd4f52c14b7, NAME => 'testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7.', STARTKEY => '1', ENDKEY => '2'} 2023-11-21 13:55:23,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:23,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:23,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:23,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:23,359 INFO [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:23,360 DEBUG [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1 2023-11-21 13:55:23,360 DEBUG [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1 2023-11-21 13:55:23,360 INFO [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 489c1aeed0cfc5efd1e74cd4f52c14b7 columnFamilyName family1 2023-11-21 13:55:23,370 DEBUG [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-2d7339555d73468f8a547deac0e4da1f 2023-11-21 13:55:23,375 DEBUG [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-56443ee5aa1b4940986938fa8c027eea 2023-11-21 13:55:23,379 DEBUG [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-5ac3b165f9eb4dcf896fc3fc1071be28 2023-11-21 13:55:23,384 DEBUG [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-5d43ef103d274dc3a9bb93309c6608d8 2023-11-21 13:55:23,384 INFO [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] regionserver.HStore(310): Store=489c1aeed0cfc5efd1e74cd4f52c14b7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:23,384 INFO [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:23,385 DEBUG [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2 2023-11-21 13:55:23,385 DEBUG [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2 2023-11-21 13:55:23,385 INFO [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 489c1aeed0cfc5efd1e74cd4f52c14b7 columnFamilyName family2 2023-11-21 13:55:23,392 DEBUG [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-2813c6537fff4fc5970e0d660f5a3b9a 2023-11-21 13:55:23,397 DEBUG [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-5502cef6742140928005a8fc6f731c04 2023-11-21 13:55:23,401 DEBUG [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-7b31f03ff7ab433fb4c5ea94135b0d63 2023-11-21 13:55:23,406 DEBUG [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-c1dc51a16a0c40feaaaafdc263319ddb 2023-11-21 13:55:23,406 INFO [StoreOpener-489c1aeed0cfc5efd1e74cd4f52c14b7-1] regionserver.HStore(310): Store=489c1aeed0cfc5efd1e74cd4f52c14b7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:23,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:23,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:23,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-21 13:55:23,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:55:23,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 489c1aeed0cfc5efd1e74cd4f52c14b7; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68130962, jitterRate=0.015230447053909302}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-21 13:55:23,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 489c1aeed0cfc5efd1e74cd4f52c14b7: 2023-11-21 13:55:23,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7., pid=102, masterSystemTime=1700574923355 2023-11-21 13:55:23,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:55:23,412 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-21 13:55:23,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-21 13:55:23,412 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-21 13:55:23,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:23,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:23,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:23,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2c2220da91c79539696a8094984e331e, NAME => 'testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e.', STARTKEY => '', ENDKEY => '1'} 2023-11-21 13:55:23,415 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=489c1aeed0cfc5efd1e74cd4f52c14b7, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:23,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 2c2220da91c79539696a8094984e331e 2023-11-21 13:55:23,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:23,415 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700574923414"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574923414"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574923414"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574923414"}]},"ts":"1700574923414"} 2023-11-21 13:55:23,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 2c2220da91c79539696a8094984e331e 2023-11-21 13:55:23,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 2c2220da91c79539696a8094984e331e 2023-11-21 13:55:23,416 INFO [StoreOpener-2c2220da91c79539696a8094984e331e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2c2220da91c79539696a8094984e331e 2023-11-21 13:55:23,418 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=102, resume processing ppid=99 2023-11-21 13:55:23,418 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure 489c1aeed0cfc5efd1e74cd4f52c14b7, server=jenkins-hbase6.apache.org,46365,1700574804408 in 212 msec 2023-11-21 13:55:23,419 DEBUG [StoreOpener-2c2220da91c79539696a8094984e331e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1 2023-11-21 13:55:23,419 DEBUG [StoreOpener-2c2220da91c79539696a8094984e331e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1 2023-11-21 13:55:23,419 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=489c1aeed0cfc5efd1e74cd4f52c14b7, ASSIGN in 370 msec 2023-11-21 13:55:23,419 INFO [StoreOpener-2c2220da91c79539696a8094984e331e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c2220da91c79539696a8094984e331e columnFamilyName family1 2023-11-21 13:55:23,419 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-21 13:55:23,419 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.HStore(1912): 489c1aeed0cfc5efd1e74cd4f52c14b7/family2 is initiating minor compaction (all files) 2023-11-21 13:55:23,419 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-21 13:55:23,419 INFO [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 489c1aeed0cfc5efd1e74cd4f52c14b7/family2 in testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:23,419 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1912): 489c1aeed0cfc5efd1e74cd4f52c14b7/family1 is initiating minor compaction (all files) 2023-11-21 13:55:23,419 INFO [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-2813c6537fff4fc5970e0d660f5a3b9a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-5502cef6742140928005a8fc6f731c04, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-7b31f03ff7ab433fb4c5ea94135b0d63, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-c1dc51a16a0c40feaaaafdc263319ddb] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp, totalSize=20.4 K 2023-11-21 13:55:23,419 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 489c1aeed0cfc5efd1e74cd4f52c14b7/family1 in testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:55:23,420 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-2d7339555d73468f8a547deac0e4da1f, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-5ac3b165f9eb4dcf896fc3fc1071be28, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-5d43ef103d274dc3a9bb93309c6608d8, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-56443ee5aa1b4940986938fa8c027eea] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp, totalSize=21.6 K 2023-11-21 13:55:23,421 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-2d7339555d73468f8a547deac0e4da1f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574906720 2023-11-21 13:55:23,421 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-2813c6537fff4fc5970e0d660f5a3b9a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574906720 2023-11-21 13:55:23,421 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-5ac3b165f9eb4dcf896fc3fc1071be28, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574908523 2023-11-21 13:55:23,421 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-5502cef6742140928005a8fc6f731c04, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574908523 2023-11-21 13:55:23,422 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-5d43ef103d274dc3a9bb93309c6608d8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574909916 2023-11-21 13:55:23,422 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-7b31f03ff7ab433fb4c5ea94135b0d63, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574909916 2023-11-21 13:55:23,423 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-56443ee5aa1b4940986938fa8c027eea, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574911716 2023-11-21 13:55:23,424 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-c1dc51a16a0c40feaaaafdc263319ddb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574911716 2023-11-21 13:55:23,433 DEBUG [StoreOpener-2c2220da91c79539696a8094984e331e-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-08c9168407a946debf88df93938065a2 2023-11-21 13:55:23,443 DEBUG [StoreOpener-2c2220da91c79539696a8094984e331e-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-625ff5eabac64bcd9f0e5ba027931c53 2023-11-21 13:55:23,455 DEBUG [StoreOpener-2c2220da91c79539696a8094984e331e-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-cd97572f1e9141dc889c7492f46cece6 2023-11-21 13:55:23,457 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 489c1aeed0cfc5efd1e74cd4f52c14b7#family1#compaction#114 average throughput is 0.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-21 13:55:23,467 INFO [RS:0;jenkins-hbase6:46365-longCompactions-0] throttle.PressureAwareThroughputController(145): 489c1aeed0cfc5efd1e74cd4f52c14b7#family2#compaction#115 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-21 13:55:23,471 DEBUG [StoreOpener-2c2220da91c79539696a8094984e331e-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-cd9a918c980747cb955ab2f73dee69a6 2023-11-21 13:55:23,474 INFO [StoreOpener-2c2220da91c79539696a8094984e331e-1] regionserver.HStore(310): Store=2c2220da91c79539696a8094984e331e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:23,475 INFO [StoreOpener-2c2220da91c79539696a8094984e331e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2c2220da91c79539696a8094984e331e 2023-11-21 13:55:23,476 DEBUG [StoreOpener-2c2220da91c79539696a8094984e331e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2 2023-11-21 13:55:23,476 DEBUG [StoreOpener-2c2220da91c79539696a8094984e331e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2 2023-11-21 13:55:23,476 INFO [StoreOpener-2c2220da91c79539696a8094984e331e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c2220da91c79539696a8094984e331e columnFamilyName family2 2023-11-21 13:55:23,484 DEBUG [StoreOpener-2c2220da91c79539696a8094984e331e-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-7669c129d1c947e2b93c80da48fe282d 2023-11-21 13:55:23,488 DEBUG [StoreOpener-2c2220da91c79539696a8094984e331e-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-7726f25dbada4e85a3299254e5fa012e 2023-11-21 13:55:23,493 DEBUG [StoreOpener-2c2220da91c79539696a8094984e331e-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-8a0bfb9aaea443ce937260a1c1b4218b 2023-11-21 13:55:23,501 DEBUG [StoreOpener-2c2220da91c79539696a8094984e331e-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-9cefbb6708ea467c83688fd844c68bb7 2023-11-21 13:55:23,501 INFO [StoreOpener-2c2220da91c79539696a8094984e331e-1] regionserver.HStore(310): Store=2c2220da91c79539696a8094984e331e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:23,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e 2023-11-21 13:55:23,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e 2023-11-21 13:55:23,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-21 13:55:23,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 2c2220da91c79539696a8094984e331e 2023-11-21 13:55:23,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 2c2220da91c79539696a8094984e331e; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70684561, jitterRate=0.05328203737735748}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-21 13:55:23,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 2c2220da91c79539696a8094984e331e: 2023-11-21 13:55:23,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e., pid=103, masterSystemTime=1700574923355 2023-11-21 13:55:23,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-21 13:55:23,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-21 13:55:23,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:23,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:23,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:23,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a3726db2a6d35a4ace20911e14a84575, NAME => 'testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575.', STARTKEY => '2', ENDKEY => ''} 2023-11-21 13:55:23,508 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=2c2220da91c79539696a8094984e331e, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:23,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:23,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:23,508 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700574923508"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574923508"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574923508"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574923508"}]},"ts":"1700574923508"} 2023-11-21 13:55:23,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:23,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:23,510 INFO [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:23,510 DEBUG [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1 2023-11-21 13:55:23,510 DEBUG [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1 2023-11-21 13:55:23,511 INFO [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3726db2a6d35a4ace20911e14a84575 columnFamilyName family1 2023-11-21 13:55:23,511 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=103, resume processing ppid=98 2023-11-21 13:55:23,511 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure 2c2220da91c79539696a8094984e331e, server=jenkins-hbase6.apache.org,46365,1700574804408 in 305 msec 2023-11-21 13:55:23,512 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2c2220da91c79539696a8094984e331e, ASSIGN in 463 msec 2023-11-21 13:55:23,517 DEBUG [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-06b3d411f57145f99e7bb0ad83ecbcb8 2023-11-21 13:55:23,521 DEBUG [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-833631d8fbac4f798e75e0acd31d627d 2023-11-21 13:55:23,524 DEBUG [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-8c0ab801c71b4268811d600415bb2ac7 2023-11-21 13:55:23,528 DEBUG [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-ba71260c9f2745e5bff68c68527fdd0a 2023-11-21 13:55:23,528 INFO [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] regionserver.HStore(310): Store=a3726db2a6d35a4ace20911e14a84575/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:23,529 INFO [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:23,529 DEBUG [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2 2023-11-21 13:55:23,529 DEBUG [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2 2023-11-21 13:55:23,530 INFO [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3726db2a6d35a4ace20911e14a84575 columnFamilyName family2 2023-11-21 13:55:23,535 DEBUG [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-17d29f4adc654a13b4cada34bc7f4d31 2023-11-21 13:55:23,539 DEBUG [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-7cacaaa69f874133add2611b3499950e 2023-11-21 13:55:23,543 DEBUG [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-cc1e2abdb8b84b0a8e5b474cdb792e45 2023-11-21 13:55:23,547 DEBUG [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] regionserver.HStore(539): loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-fe584384e451421e966c64b193ca6784 2023-11-21 13:55:23,548 INFO [StoreOpener-a3726db2a6d35a4ace20911e14a84575-1] regionserver.HStore(310): Store=a3726db2a6d35a4ace20911e14a84575/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:23,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:23,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:23,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-21 13:55:23,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:55:23,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened a3726db2a6d35a4ace20911e14a84575; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64455761, jitterRate=-0.0395343154668808}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-21 13:55:23,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for a3726db2a6d35a4ace20911e14a84575: 2023-11-21 13:55:23,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575., pid=101, masterSystemTime=1700574923355 2023-11-21 13:55:23,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-21 13:55:23,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-21 13:55:23,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:23,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:23,555 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=a3726db2a6d35a4ace20911e14a84575, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:23,556 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700574923555"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574923555"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574923555"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574923555"}]},"ts":"1700574923555"} 2023-11-21 13:55:23,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=101, resume processing ppid=100 2023-11-21 13:55:23,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure a3726db2a6d35a4ace20911e14a84575, server=jenkins-hbase6.apache.org,46365,1700574804408 in 354 msec 2023-11-21 13:55:23,560 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=100, resume processing ppid=97 2023-11-21 13:55:23,560 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a3726db2a6d35a4ace20911e14a84575, ASSIGN in 510 msec 2023-11-21 13:55:23,560 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574923560"}]},"ts":"1700574923560"} 2023-11-21 13:55:23,561 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-21 13:55:23,564 INFO [PEWorker-5] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-21 13:55:23,565 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 527 msec 2023-11-21 13:55:23,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-21 13:55:23,647 INFO [Listener at localhost/35077] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-21 13:55:23,659 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:55:23,670 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:55:23,680 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:55:23,681 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:55:23,687 INFO [Listener at localhost/35077] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-21 13:55:23,702 INFO [Listener at localhost/35077] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-21 13:55:23,702 INFO [Listener at localhost/35077] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-21 13:55:23,703 DEBUG [Listener at localhost/35077] zookeeper.ReadOnlyZKClient(139): Connect 0x357c2d05 to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:55:23,708 DEBUG [Listener at localhost/35077] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e2ecf65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:55:23,708 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231121 for table='testCompactionWithHFileLink' and column='family1' 2023-11-21 13:55:23,708 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231121 for table='testCompactionWithHFileLink' and column='family1' 2023-11-21 13:55:23,708 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231121 for table='testCompactionWithHFileLink' and column='family1' 2023-11-21 13:55:24,561 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112160d7f2b65fea4bfb9386b9f99b55da78 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112160d7f2b65fea4bfb9386b9f99b55da78 2023-11-21 13:55:24,562 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231121ff3471ebdbd04b0c895f72030c749214 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231121ff3471ebdbd04b0c895f72030c749214 2023-11-21 13:55:24,562 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231121 table='testCompactionWithHFileLink' column='family1' 2023-11-21 13:55:24,563 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231121 table='testCompactionWithHFileLink' column='family1' 2023-11-21 13:55:24,563 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311218765a491c06243118dff7e1cc940047a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311218765a491c06243118dff7e1cc940047a 2023-11-21 13:55:24,564 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231121 table='testCompactionWithHFileLink' column='family1' 2023-11-21 13:55:24,576 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:55:24,584 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:60868, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:55:24,597 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-21 13:55:24,606 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:33286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-21 13:55:24,628 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231121/family1/128a79a01c614e32bb9e2ffd78df65a5 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-21 13:55:24,628 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231121/family1/83e41751b53d4752bca28c96660cf80e first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-21 13:55:24,629 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=32 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231121/family1/83e41751b53d4752bca28c96660cf80e}] 2023-11-21 13:55:24,630 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231121/family1/128a79a01c614e32bb9e2ffd78df65a5}] 2023-11-21 13:55:24,634 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231121/family1/71b57ab048204155ba181fc3c759a4d0 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-21 13:55:24,635 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231121/family1/71b57ab048204155ba181fc3c759a4d0}] 2023-11-21 13:55:24,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231121/family1/83e41751b53d4752bca28c96660cf80e for inclusion in 2c2220da91c79539696a8094984e331e/family1 2023-11-21 13:55:24,638 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231121/family1/128a79a01c614e32bb9e2ffd78df65a5 for inclusion in a3726db2a6d35a4ace20911e14a84575/family1 2023-11-21 13:55:24,638 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231121/family1/71b57ab048204155ba181fc3c759a4d0 for inclusion in 489c1aeed0cfc5efd1e74cd4f52c14b7/family1 2023-11-21 13:55:24,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-21 13:55:24,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last=1 2023-11-21 13:55:24,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 2c2220da91c79539696a8094984e331e: 2023-11-21 13:55:24,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-21 13:55:24,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-21 13:55:24,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 489c1aeed0cfc5efd1e74cd4f52c14b7: 2023-11-21 13:55:24,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-21 13:55:24,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-21 13:55:24,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for a3726db2a6d35a4ace20911e14a84575: 2023-11-21 13:55:24,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231121/family1/83e41751b53d4752bca28c96660cf80e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__h913sm6rm766uajep1frbv7dlkrkekru7nv5cvvnev2njeotqqr06hdhlm3msjfi/family1/83e41751b53d4752bca28c96660cf80e 2023-11-21 13:55:24,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231121/family1/71b57ab048204155ba181fc3c759a4d0 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__d11darggsa1q9scuia853emr3va7o7b1817fd60c1eqkmu9crlc2deisv9olfpq0/family1/71b57ab048204155ba181fc3c759a4d0 2023-11-21 13:55:24,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231121/family1/128a79a01c614e32bb9e2ffd78df65a5 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__qjm9g0j2v20fi8e27g92ubsdmj26dshvodr6jh49br8efo6o449u03rmkg6f1h7k/family1/128a79a01c614e32bb9e2ffd78df65a5 2023-11-21 13:55:24,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__d11darggsa1q9scuia853emr3va7o7b1817fd60c1eqkmu9crlc2deisv9olfpq0/family1/71b57ab048204155ba181fc3c759a4d0 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/6dd10e602e7a4faa805604adc7c55a81_SeqId_34_ 2023-11-21 13:55:24,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__h913sm6rm766uajep1frbv7dlkrkekru7nv5cvvnev2njeotqqr06hdhlm3msjfi/family1/83e41751b53d4752bca28c96660cf80e as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/1d624f8a790d4dd194fafb3ccbc9f035_SeqId_34_ 2023-11-21 13:55:24,650 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__d11darggsa1q9scuia853emr3va7o7b1817fd60c1eqkmu9crlc2deisv9olfpq0/family1/71b57ab048204155ba181fc3c759a4d0 into 489c1aeed0cfc5efd1e74cd4f52c14b7/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/6dd10e602e7a4faa805604adc7c55a81_SeqId_34_ - updating store file list. 2023-11-21 13:55:24,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__qjm9g0j2v20fi8e27g92ubsdmj26dshvodr6jh49br8efo6o449u03rmkg6f1h7k/family1/128a79a01c614e32bb9e2ffd78df65a5 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/cfce9b773f8e409d9627519fbf778904_SeqId_34_ 2023-11-21 13:55:24,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__h913sm6rm766uajep1frbv7dlkrkekru7nv5cvvnev2njeotqqr06hdhlm3msjfi/family1/83e41751b53d4752bca28c96660cf80e into 2c2220da91c79539696a8094984e331e/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/1d624f8a790d4dd194fafb3ccbc9f035_SeqId_34_ - updating store file list. 2023-11-21 13:55:24,651 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__qjm9g0j2v20fi8e27g92ubsdmj26dshvodr6jh49br8efo6o449u03rmkg6f1h7k/family1/128a79a01c614e32bb9e2ffd78df65a5 into a3726db2a6d35a4ace20911e14a84575/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/cfce9b773f8e409d9627519fbf778904_SeqId_34_ - updating store file list. 2023-11-21 13:55:24,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/1d624f8a790d4dd194fafb3ccbc9f035_SeqId_34_ into 2c2220da91c79539696a8094984e331e/family1 2023-11-21 13:55:24,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__h913sm6rm766uajep1frbv7dlkrkekru7nv5cvvnev2njeotqqr06hdhlm3msjfi/family1/83e41751b53d4752bca28c96660cf80e into 2c2220da91c79539696a8094984e331e/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/1d624f8a790d4dd194fafb3ccbc9f035_SeqId_34_) 2023-11-21 13:55:24,657 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/6dd10e602e7a4faa805604adc7c55a81_SeqId_34_ into 489c1aeed0cfc5efd1e74cd4f52c14b7/family1 2023-11-21 13:55:24,657 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__d11darggsa1q9scuia853emr3va7o7b1817fd60c1eqkmu9crlc2deisv9olfpq0/family1/71b57ab048204155ba181fc3c759a4d0 into 489c1aeed0cfc5efd1e74cd4f52c14b7/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/6dd10e602e7a4faa805604adc7c55a81_SeqId_34_) 2023-11-21 13:55:24,657 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/cfce9b773f8e409d9627519fbf778904_SeqId_34_ into a3726db2a6d35a4ace20911e14a84575/family1 2023-11-21 13:55:24,657 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__qjm9g0j2v20fi8e27g92ubsdmj26dshvodr6jh49br8efo6o449u03rmkg6f1h7k/family1/128a79a01c614e32bb9e2ffd78df65a5 into a3726db2a6d35a4ace20911e14a84575/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/cfce9b773f8e409d9627519fbf778904_SeqId_34_) 2023-11-21 13:55:24,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__d11darggsa1q9scuia853emr3va7o7b1817fd60c1eqkmu9crlc2deisv9olfpq0/family1/71b57ab048204155ba181fc3c759a4d0 2023-11-21 13:55:24,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__h913sm6rm766uajep1frbv7dlkrkekru7nv5cvvnev2njeotqqr06hdhlm3msjfi/family1/83e41751b53d4752bca28c96660cf80e 2023-11-21 13:55:24,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:55:24,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testCompactionWithHFileLink__qjm9g0j2v20fi8e27g92ubsdmj26dshvodr6jh49br8efo6o449u03rmkg6f1h7k/family1/128a79a01c614e32bb9e2ffd78df65a5 2023-11-21 13:55:24,661 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231121 table='testCompactionWithHFileLink' column='family1' 2023-11-21 13:55:24,661 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:24,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-21 13:55:24,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(1912): 2c2220da91c79539696a8094984e331e/family1 is initiating minor compaction (all files) 2023-11-21 13:55:24,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@181cf5b2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-21 13:55:24,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:55:24,663 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231121b2f42049d02a4b37a43e96962c985b9e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231121b2f42049d02a4b37a43e96962c985b9e 2023-11-21 13:55:24,664 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231121 table='testCompactionWithHFileLink' column='family1' 2023-11-21 13:55:24,664 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231121f8a34cc10a484ecba803bde3af1ea1bf to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231121f8a34cc10a484ecba803bde3af1ea1bf 2023-11-21 13:55:24,665 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:24,665 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231121fdc3a9147e0b46dc9d057989571b4a9a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231121fdc3a9147e0b46dc9d057989571b4a9a 2023-11-21 13:55:24,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-21 13:55:24,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(1912): a3726db2a6d35a4ace20911e14a84575/family1 is initiating minor compaction (all files) 2023-11-21 13:55:24,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@ddf1bc1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-11-21 13:55:24,666 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311210fa8109b150d464882a6f44b66b5d449 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311210fa8109b150d464882a6f44b66b5d449 2023-11-21 13:55:24,666 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231121ffd1c159ecbf4349af9e328e2916bd4c to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231121ffd1c159ecbf4349af9e328e2916bd4c 2023-11-21 13:55:24,667 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-21 13:55:24,667 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231121' 2023-11-21 13:55:24,667 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231121 for table='testCompactionWithHFileLink' and column='family1' 2023-11-21 13:55:24,667 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023112181ef61da86b84d23ae5aeafb54c77cea to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023112181ef61da86b84d23ae5aeafb54c77cea 2023-11-21 13:55:24,668 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231121 table='testCompactionWithHFileLink' column='family1' 2023-11-21 13:55:24,669 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:24,669 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311219416ad37fc114e388efa2d0add8e46e8 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311219416ad37fc114e388efa2d0add8e46e8 2023-11-21 13:55:24,670 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231121ec7e5d4ccdd649ea9c5552974861856b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231121ec7e5d4ccdd649ea9c5552974861856b 2023-11-21 13:55:24,670 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-21 13:55:24,670 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231121' 2023-11-21 13:55:24,670 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231121477c593f302a4ebb8e41d1f4bc2d3465 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231121477c593f302a4ebb8e41d1f4bc2d3465 2023-11-21 13:55:24,670 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231121 for table='testCompactionWithHFileLink' and column='family1' 2023-11-21 13:55:24,671 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231121481ced72e8634a0e8e51921117a1da00 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231121481ced72e8634a0e8e51921117a1da00 2023-11-21 13:55:24,672 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231121b619ba38965f4976843c9f63139f217a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231121b619ba38965f4976843c9f63139f217a 2023-11-21 13:55:24,673 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231121d370efe300e447308cc51bb4e12ae2ab to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231121d370efe300e447308cc51bb4e12ae2ab 2023-11-21 13:55:24,673 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-21 13:55:24,673 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231121' 2023-11-21 13:55:24,673 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231121 for table='testCompactionWithHFileLink' and column='family1' 2023-11-21 13:55:24,673 INFO [Listener at localhost/35077] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-21 13:55:24,676 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:55:24,678 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:55:24,681 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:55:24,682 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:55:24,684 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family1/2d179239ae154bfb8a430b33265fc30b as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/2d179239ae154bfb8a430b33265fc30b 2023-11-21 13:55:24,688 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:55:24,689 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 489c1aeed0cfc5efd1e74cd4f52c14b7/family1 of 489c1aeed0cfc5efd1e74cd4f52c14b7 into 2d179239ae154bfb8a430b33265fc30b(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-21 13:55:24,689 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 489c1aeed0cfc5efd1e74cd4f52c14b7: 2023-11-21 13:55:24,689 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7., storeName=489c1aeed0cfc5efd1e74cd4f52c14b7/family1, priority=12, startTime=1700574923412; duration=1sec 2023-11-21 13:55:24,690 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-11-21 13:55:24,690 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2c2220da91c79539696a8094984e331e/family1 in testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:24,690 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-625ff5eabac64bcd9f0e5ba027931c53, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-cd9a918c980747cb955ab2f73dee69a6, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-08c9168407a946debf88df93938065a2, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-cd97572f1e9141dc889c7492f46cece6, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/1d624f8a790d4dd194fafb3ccbc9f035_SeqId_34_] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp, totalSize=28.9 K 2023-11-21 13:55:24,690 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/.tmp/family2/c81ff40d09414e3e92575111d090b6d0 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/c81ff40d09414e3e92575111d090b6d0 2023-11-21 13:55:24,691 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-625ff5eabac64bcd9f0e5ba027931c53, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574906718 2023-11-21 13:55:24,691 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:55:24,691 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-cd9a918c980747cb955ab2f73dee69a6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574908523 2023-11-21 13:55:24,693 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-08c9168407a946debf88df93938065a2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574909916 2023-11-21 13:55:24,696 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-cd97572f1e9141dc889c7492f46cece6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574911716 2023-11-21 13:55:24,696 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 1d624f8a790d4dd194fafb3ccbc9f035_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1700574906718 2023-11-21 13:55:24,697 INFO [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 489c1aeed0cfc5efd1e74cd4f52c14b7/family2 of 489c1aeed0cfc5efd1e74cd4f52c14b7 into c81ff40d09414e3e92575111d090b6d0(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-21 13:55:24,697 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 489c1aeed0cfc5efd1e74cd4f52c14b7: 2023-11-21 13:55:24,697 INFO [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7., storeName=489c1aeed0cfc5efd1e74cd4f52c14b7/family2, priority=12, startTime=1700574923412; duration=1sec 2023-11-21 13:55:24,697 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-21 13:55:24,697 INFO [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.HRegion(2259): Starting compaction of a3726db2a6d35a4ace20911e14a84575/family1 in testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:24,697 INFO [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-06b3d411f57145f99e7bb0ad83ecbcb8, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-833631d8fbac4f798e75e0acd31d627d, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-8c0ab801c71b4268811d600415bb2ac7, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-ba71260c9f2745e5bff68c68527fdd0a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/cfce9b773f8e409d9627519fbf778904_SeqId_34_] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp, totalSize=28.9 K 2023-11-21 13:55:24,698 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-06b3d411f57145f99e7bb0ad83ecbcb8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574906721 2023-11-21 13:55:24,699 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-833631d8fbac4f798e75e0acd31d627d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574908524 2023-11-21 13:55:24,702 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-8c0ab801c71b4268811d600415bb2ac7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574909916 2023-11-21 13:55:24,703 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-ba71260c9f2745e5bff68c68527fdd0a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574911716 2023-11-21 13:55:24,703 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.Compactor(207): Compacting cfce9b773f8e409d9627519fbf778904_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1700574906721 2023-11-21 13:55:24,711 INFO [Listener at localhost/35077] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=291 (was 239) - Thread LEAK? -, OpenFileDescriptor=798 (was 625) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=163 (was 135) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 172), AvailableMemoryMB=7214 (was 6910) - AvailableMemoryMB LEAK? - 2023-11-21 13:55:24,716 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-2d7339555d73468f8a547deac0e4da1f, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-5ac3b165f9eb4dcf896fc3fc1071be28, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-5d43ef103d274dc3a9bb93309c6608d8, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-56443ee5aa1b4940986938fa8c027eea] to archive 2023-11-21 13:55:24,716 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:24,718 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-2d7339555d73468f8a547deac0e4da1f to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-2d7339555d73468f8a547deac0e4da1f 2023-11-21 13:55:24,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-5ac3b165f9eb4dcf896fc3fc1071be28 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-5ac3b165f9eb4dcf896fc3fc1071be28 2023-11-21 13:55:24,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-5d43ef103d274dc3a9bb93309c6608d8 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-5d43ef103d274dc3a9bb93309c6608d8 2023-11-21 13:55:24,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-56443ee5aa1b4940986938fa8c027eea to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family1/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-56443ee5aa1b4940986938fa8c027eea 2023-11-21 13:55:24,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-2813c6537fff4fc5970e0d660f5a3b9a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-5502cef6742140928005a8fc6f731c04, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-7b31f03ff7ab433fb4c5ea94135b0d63, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-c1dc51a16a0c40feaaaafdc263319ddb] to archive 2023-11-21 13:55:24,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:24,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-2813c6537fff4fc5970e0d660f5a3b9a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-2813c6537fff4fc5970e0d660f5a3b9a 2023-11-21 13:55:24,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-5502cef6742140928005a8fc6f731c04 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-5502cef6742140928005a8fc6f731c04 2023-11-21 13:55:24,729 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-7b31f03ff7ab433fb4c5ea94135b0d63 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-7b31f03ff7ab433fb4c5ea94135b0d63 2023-11-21 13:55:24,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-c1dc51a16a0c40feaaaafdc263319ddb to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/family2/testCompactionWithHFileLink=489c1aeed0cfc5efd1e74cd4f52c14b7-c1dc51a16a0c40feaaaafdc263319ddb 2023-11-21 13:55:24,731 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2c2220da91c79539696a8094984e331e#family1#compaction#116 average throughput is 0.14 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 69.23 MB/second 2023-11-21 13:55:24,739 INFO [Listener at localhost/35077] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=286, OpenFileDescriptor=786, MaxFileDescriptor=60000, SystemLoadAverage=174, ProcessCount=168, AvailableMemoryMB=7228 2023-11-21 13:55:24,741 INFO [RS:0;jenkins-hbase6:46365-longCompactions-0] throttle.PressureAwareThroughputController(145): a3726db2a6d35a4ace20911e14a84575#family1#compaction#117 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 69.23 MB/second 2023-11-21 13:55:24,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$15(3014): Client=jenkins//172.31.2.20 creating {NAME => 'ns'} 2023-11-21 13:55:24,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-21 13:55:24,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-21 13:55:24,754 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-21 13:55:24,756 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 8 msec 2023-11-21 13:55:24,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-21 13:55:24,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-21 13:55:24,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-21 13:55:24,857 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-21 13:55:24,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-21 13:55:24,858 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-21 13:55:24,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-21 13:55:24,860 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc 2023-11-21 13:55:24,860 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b 2023-11-21 13:55:24,860 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2 2023-11-21 13:55:24,860 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc empty. 2023-11-21 13:55:24,860 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2 empty. 2023-11-21 13:55:24,860 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b empty. 2023-11-21 13:55:24,860 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc 2023-11-21 13:55:24,860 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b 2023-11-21 13:55:24,861 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2 2023-11-21 13:55:24,861 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-21 13:55:24,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-21 13:55:25,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-21 13:55:25,267 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-21 13:55:25,269 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => e72e2258c53c48d805ce683abe6d24d2, NAME => 'ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:55:25,269 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5cb093399d723625f3078fe0d10bdf3b, NAME => 'ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:55:25,269 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 25535f294975fa5548703e68e64b1bfc, NAME => 'ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:55:25,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-21 13:55:25,600 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-21 13:55:25,675 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:25,675 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:25,675 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing e72e2258c53c48d805ce683abe6d24d2, disabling compactions & flushes 2023-11-21 13:55:25,675 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 5cb093399d723625f3078fe0d10bdf3b, disabling compactions & flushes 2023-11-21 13:55:25,675 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:25,675 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:25,675 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 25535f294975fa5548703e68e64b1bfc, disabling compactions & flushes 2023-11-21 13:55:25,675 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:25,675 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:25,675 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. after waiting 0 ms 2023-11-21 13:55:25,675 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:25,676 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:25,675 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:25,676 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:25,676 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:25,676 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for e72e2258c53c48d805ce683abe6d24d2: 2023-11-21 13:55:25,676 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. after waiting 0 ms 2023-11-21 13:55:25,676 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:25,676 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. after waiting 0 ms 2023-11-21 13:55:25,676 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:25,676 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:25,676 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 25535f294975fa5548703e68e64b1bfc: 2023-11-21 13:55:25,676 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:25,676 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 5cb093399d723625f3078fe0d10bdf3b: 2023-11-21 13:55:25,678 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-21 13:55:25,679 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700574925679"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574925679"}]},"ts":"1700574925679"} 2023-11-21 13:55:25,679 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700574925679"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574925679"}]},"ts":"1700574925679"} 2023-11-21 13:55:25,679 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700574925679"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574925679"}]},"ts":"1700574925679"} 2023-11-21 13:55:25,681 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-21 13:55:25,682 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-21 13:55:25,682 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574925682"}]},"ts":"1700574925682"} 2023-11-21 13:55:25,683 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-21 13:55:25,685 DEBUG [regionserver/jenkins-hbase6:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-11-21 13:55:25,691 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=25535f294975fa5548703e68e64b1bfc, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5cb093399d723625f3078fe0d10bdf3b, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=e72e2258c53c48d805ce683abe6d24d2, ASSIGN}] 2023-11-21 13:55:25,693 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=e72e2258c53c48d805ce683abe6d24d2, ASSIGN 2023-11-21 13:55:25,693 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5cb093399d723625f3078fe0d10bdf3b, ASSIGN 2023-11-21 13:55:25,693 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=25535f294975fa5548703e68e64b1bfc, ASSIGN 2023-11-21 13:55:25,693 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=e72e2258c53c48d805ce683abe6d24d2, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:55:25,693 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5cb093399d723625f3078fe0d10bdf3b, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:55:25,693 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=25535f294975fa5548703e68e64b1bfc, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:55:25,846 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=25535f294975fa5548703e68e64b1bfc, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:25,846 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=5cb093399d723625f3078fe0d10bdf3b, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:25,846 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=e72e2258c53c48d805ce683abe6d24d2, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:25,846 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700574925846"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574925846"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574925846"}]},"ts":"1700574925846"} 2023-11-21 13:55:25,846 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700574925846"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574925846"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574925846"}]},"ts":"1700574925846"} 2023-11-21 13:55:25,846 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700574925846"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574925846"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574925846"}]},"ts":"1700574925846"} 2023-11-21 13:55:25,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 25535f294975fa5548703e68e64b1bfc, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:25,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=107, state=RUNNABLE; OpenRegionProcedure 5cb093399d723625f3078fe0d10bdf3b, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:25,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure e72e2258c53c48d805ce683abe6d24d2, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:25,957 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family1/d5d676f9527442e5b69e0319cbf05ea1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/d5d676f9527442e5b69e0319cbf05ea1 2023-11-21 13:55:25,957 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family1/4ec8a2660782437a9c3c6674ad708594 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/4ec8a2660782437a9c3c6674ad708594 2023-11-21 13:55:25,961 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 2c2220da91c79539696a8094984e331e/family1 of 2c2220da91c79539696a8094984e331e into d5d676f9527442e5b69e0319cbf05ea1(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-21 13:55:25,961 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2c2220da91c79539696a8094984e331e: 2023-11-21 13:55:25,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-21 13:55:25,961 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1700574924662; duration=1sec 2023-11-21 13:55:25,961 INFO [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in a3726db2a6d35a4ace20911e14a84575/family1 of a3726db2a6d35a4ace20911e14a84575 into 4ec8a2660782437a9c3c6674ad708594(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-21 13:55:25,961 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-21 13:55:25,961 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for a3726db2a6d35a4ace20911e14a84575: 2023-11-21 13:55:25,961 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-21 13:55:25,962 INFO [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1700574924666; duration=1sec 2023-11-21 13:55:25,962 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-21 13:55:25,962 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-21 13:55:25,963 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-21 13:55:25,964 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1912): 2c2220da91c79539696a8094984e331e/family2 is initiating minor compaction (all files) 2023-11-21 13:55:25,964 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2c2220da91c79539696a8094984e331e/family2 in testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:55:25,964 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-7669c129d1c947e2b93c80da48fe282d, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-9cefbb6708ea467c83688fd844c68bb7, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-8a0bfb9aaea443ce937260a1c1b4218b, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-7726f25dbada4e85a3299254e5fa012e] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp, totalSize=20.4 K 2023-11-21 13:55:25,964 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-21 13:55:25,964 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.HStore(1912): a3726db2a6d35a4ace20911e14a84575/family2 is initiating minor compaction (all files) 2023-11-21 13:55:25,964 INFO [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.HRegion(2259): Starting compaction of a3726db2a6d35a4ace20911e14a84575/family2 in testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:55:25,964 INFO [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-7cacaaa69f874133add2611b3499950e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-fe584384e451421e966c64b193ca6784, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-cc1e2abdb8b84b0a8e5b474cdb792e45, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-17d29f4adc654a13b4cada34bc7f4d31] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp, totalSize=20.4 K 2023-11-21 13:55:25,964 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-7669c129d1c947e2b93c80da48fe282d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574906718 2023-11-21 13:55:25,965 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-7cacaaa69f874133add2611b3499950e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574906721 2023-11-21 13:55:25,965 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-9cefbb6708ea467c83688fd844c68bb7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574908523 2023-11-21 13:55:25,965 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-fe584384e451421e966c64b193ca6784, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574908524 2023-11-21 13:55:25,965 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-8a0bfb9aaea443ce937260a1c1b4218b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574909916 2023-11-21 13:55:25,966 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-cc1e2abdb8b84b0a8e5b474cdb792e45, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574909916 2023-11-21 13:55:25,966 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-7726f25dbada4e85a3299254e5fa012e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574911716 2023-11-21 13:55:25,966 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-17d29f4adc654a13b4cada34bc7f4d31, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574911716 2023-11-21 13:55:25,978 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2c2220da91c79539696a8094984e331e#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 57.69 MB/second 2023-11-21 13:55:25,978 INFO [RS:0;jenkins-hbase6:46365-longCompactions-0] throttle.PressureAwareThroughputController(145): a3726db2a6d35a4ace20911e14a84575#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-21 13:55:25,999 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:26,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:26,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5cb093399d723625f3078fe0d10bdf3b, NAME => 'ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b.', STARTKEY => '1', ENDKEY => '2'} 2023-11-21 13:55:26,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 5cb093399d723625f3078fe0d10bdf3b 2023-11-21 13:55:26,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:26,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 5cb093399d723625f3078fe0d10bdf3b 2023-11-21 13:55:26,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 5cb093399d723625f3078fe0d10bdf3b 2023-11-21 13:55:26,003 INFO [StoreOpener-5cb093399d723625f3078fe0d10bdf3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5cb093399d723625f3078fe0d10bdf3b 2023-11-21 13:55:26,004 DEBUG [StoreOpener-5cb093399d723625f3078fe0d10bdf3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1 2023-11-21 13:55:26,004 DEBUG [StoreOpener-5cb093399d723625f3078fe0d10bdf3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1 2023-11-21 13:55:26,004 INFO [StoreOpener-5cb093399d723625f3078fe0d10bdf3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5cb093399d723625f3078fe0d10bdf3b columnFamilyName family1 2023-11-21 13:55:26,005 INFO [StoreOpener-5cb093399d723625f3078fe0d10bdf3b-1] regionserver.HStore(310): Store=5cb093399d723625f3078fe0d10bdf3b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:26,006 INFO [StoreOpener-5cb093399d723625f3078fe0d10bdf3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5cb093399d723625f3078fe0d10bdf3b 2023-11-21 13:55:26,007 DEBUG [StoreOpener-5cb093399d723625f3078fe0d10bdf3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2 2023-11-21 13:55:26,007 DEBUG [StoreOpener-5cb093399d723625f3078fe0d10bdf3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2 2023-11-21 13:55:26,007 INFO [StoreOpener-5cb093399d723625f3078fe0d10bdf3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5cb093399d723625f3078fe0d10bdf3b columnFamilyName family2 2023-11-21 13:55:26,008 INFO [StoreOpener-5cb093399d723625f3078fe0d10bdf3b-1] regionserver.HStore(310): Store=5cb093399d723625f3078fe0d10bdf3b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:26,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b 2023-11-21 13:55:26,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b 2023-11-21 13:55:26,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-21 13:55:26,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 5cb093399d723625f3078fe0d10bdf3b 2023-11-21 13:55:26,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:55:26,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 5cb093399d723625f3078fe0d10bdf3b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69032808, jitterRate=0.028668999671936035}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-21 13:55:26,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 5cb093399d723625f3078fe0d10bdf3b: 2023-11-21 13:55:26,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b., pid=110, masterSystemTime=1700574925999 2023-11-21 13:55:26,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-06b3d411f57145f99e7bb0ad83ecbcb8, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-833631d8fbac4f798e75e0acd31d627d, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-8c0ab801c71b4268811d600415bb2ac7, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-ba71260c9f2745e5bff68c68527fdd0a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/cfce9b773f8e409d9627519fbf778904_SeqId_34_] to archive 2023-11-21 13:55:26,015 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:26,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:26,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:26,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:26,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 25535f294975fa5548703e68e64b1bfc, NAME => 'ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc.', STARTKEY => '', ENDKEY => '1'} 2023-11-21 13:55:26,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 25535f294975fa5548703e68e64b1bfc 2023-11-21 13:55:26,015 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=5cb093399d723625f3078fe0d10bdf3b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:26,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:26,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 25535f294975fa5548703e68e64b1bfc 2023-11-21 13:55:26,016 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700574926015"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574926015"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574926015"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574926015"}]},"ts":"1700574926015"} 2023-11-21 13:55:26,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 25535f294975fa5548703e68e64b1bfc 2023-11-21 13:55:26,016 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-06b3d411f57145f99e7bb0ad83ecbcb8 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-06b3d411f57145f99e7bb0ad83ecbcb8 2023-11-21 13:55:26,017 INFO [StoreOpener-25535f294975fa5548703e68e64b1bfc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 25535f294975fa5548703e68e64b1bfc 2023-11-21 13:55:26,018 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-833631d8fbac4f798e75e0acd31d627d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-833631d8fbac4f798e75e0acd31d627d 2023-11-21 13:55:26,018 DEBUG [StoreOpener-25535f294975fa5548703e68e64b1bfc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1 2023-11-21 13:55:26,018 DEBUG [StoreOpener-25535f294975fa5548703e68e64b1bfc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1 2023-11-21 13:55:26,018 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=110, resume processing ppid=107 2023-11-21 13:55:26,018 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=107, state=SUCCESS; OpenRegionProcedure 5cb093399d723625f3078fe0d10bdf3b, server=jenkins-hbase6.apache.org,46365,1700574804408 in 169 msec 2023-11-21 13:55:26,018 INFO [StoreOpener-25535f294975fa5548703e68e64b1bfc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25535f294975fa5548703e68e64b1bfc columnFamilyName family1 2023-11-21 13:55:26,019 INFO [StoreOpener-25535f294975fa5548703e68e64b1bfc-1] regionserver.HStore(310): Store=25535f294975fa5548703e68e64b1bfc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:26,019 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5cb093399d723625f3078fe0d10bdf3b, ASSIGN in 327 msec 2023-11-21 13:55:26,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-8c0ab801c71b4268811d600415bb2ac7 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-8c0ab801c71b4268811d600415bb2ac7 2023-11-21 13:55:26,019 INFO [StoreOpener-25535f294975fa5548703e68e64b1bfc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 25535f294975fa5548703e68e64b1bfc 2023-11-21 13:55:26,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-ba71260c9f2745e5bff68c68527fdd0a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-ba71260c9f2745e5bff68c68527fdd0a 2023-11-21 13:55:26,020 DEBUG [StoreOpener-25535f294975fa5548703e68e64b1bfc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2 2023-11-21 13:55:26,020 DEBUG [StoreOpener-25535f294975fa5548703e68e64b1bfc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2 2023-11-21 13:55:26,021 INFO [StoreOpener-25535f294975fa5548703e68e64b1bfc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25535f294975fa5548703e68e64b1bfc columnFamilyName family2 2023-11-21 13:55:26,021 INFO [StoreOpener-25535f294975fa5548703e68e64b1bfc-1] regionserver.HStore(310): Store=25535f294975fa5548703e68e64b1bfc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:26,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/cfce9b773f8e409d9627519fbf778904_SeqId_34_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family1/cfce9b773f8e409d9627519fbf778904_SeqId_34_ 2023-11-21 13:55:26,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc 2023-11-21 13:55:26,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc 2023-11-21 13:55:26,023 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-625ff5eabac64bcd9f0e5ba027931c53, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-cd9a918c980747cb955ab2f73dee69a6, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-08c9168407a946debf88df93938065a2, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-cd97572f1e9141dc889c7492f46cece6, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/1d624f8a790d4dd194fafb3ccbc9f035_SeqId_34_] to archive 2023-11-21 13:55:26,024 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:26,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-21 13:55:26,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 25535f294975fa5548703e68e64b1bfc 2023-11-21 13:55:26,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-625ff5eabac64bcd9f0e5ba027931c53 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-625ff5eabac64bcd9f0e5ba027931c53 2023-11-21 13:55:26,027 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-cd9a918c980747cb955ab2f73dee69a6 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-cd9a918c980747cb955ab2f73dee69a6 2023-11-21 13:55:26,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:55:26,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 25535f294975fa5548703e68e64b1bfc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68545465, jitterRate=0.021407023072242737}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-21 13:55:26,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 25535f294975fa5548703e68e64b1bfc: 2023-11-21 13:55:26,028 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-08c9168407a946debf88df93938065a2 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-08c9168407a946debf88df93938065a2 2023-11-21 13:55:26,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc., pid=109, masterSystemTime=1700574925999 2023-11-21 13:55:26,029 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-cd97572f1e9141dc889c7492f46cece6 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-cd97572f1e9141dc889c7492f46cece6 2023-11-21 13:55:26,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:26,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:26,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:26,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e72e2258c53c48d805ce683abe6d24d2, NAME => 'ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2.', STARTKEY => '2', ENDKEY => ''} 2023-11-21 13:55:26,030 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=25535f294975fa5548703e68e64b1bfc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:26,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction e72e2258c53c48d805ce683abe6d24d2 2023-11-21 13:55:26,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:26,030 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700574926030"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574926030"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574926030"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574926030"}]},"ts":"1700574926030"} 2023-11-21 13:55:26,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for e72e2258c53c48d805ce683abe6d24d2 2023-11-21 13:55:26,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for e72e2258c53c48d805ce683abe6d24d2 2023-11-21 13:55:26,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/1d624f8a790d4dd194fafb3ccbc9f035_SeqId_34_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family1/1d624f8a790d4dd194fafb3ccbc9f035_SeqId_34_ 2023-11-21 13:55:26,031 INFO [StoreOpener-e72e2258c53c48d805ce683abe6d24d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e72e2258c53c48d805ce683abe6d24d2 2023-11-21 13:55:26,032 DEBUG [StoreOpener-e72e2258c53c48d805ce683abe6d24d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1 2023-11-21 13:55:26,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=109, resume processing ppid=106 2023-11-21 13:55:26,032 DEBUG [StoreOpener-e72e2258c53c48d805ce683abe6d24d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1 2023-11-21 13:55:26,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 25535f294975fa5548703e68e64b1bfc, server=jenkins-hbase6.apache.org,46365,1700574804408 in 184 msec 2023-11-21 13:55:26,033 INFO [StoreOpener-e72e2258c53c48d805ce683abe6d24d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e72e2258c53c48d805ce683abe6d24d2 columnFamilyName family1 2023-11-21 13:55:26,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=25535f294975fa5548703e68e64b1bfc, ASSIGN in 341 msec 2023-11-21 13:55:26,033 INFO [StoreOpener-e72e2258c53c48d805ce683abe6d24d2-1] regionserver.HStore(310): Store=e72e2258c53c48d805ce683abe6d24d2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:26,034 INFO [StoreOpener-e72e2258c53c48d805ce683abe6d24d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e72e2258c53c48d805ce683abe6d24d2 2023-11-21 13:55:26,035 DEBUG [StoreOpener-e72e2258c53c48d805ce683abe6d24d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2 2023-11-21 13:55:26,035 DEBUG [StoreOpener-e72e2258c53c48d805ce683abe6d24d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2 2023-11-21 13:55:26,035 INFO [StoreOpener-e72e2258c53c48d805ce683abe6d24d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e72e2258c53c48d805ce683abe6d24d2 columnFamilyName family2 2023-11-21 13:55:26,036 INFO [StoreOpener-e72e2258c53c48d805ce683abe6d24d2-1] regionserver.HStore(310): Store=e72e2258c53c48d805ce683abe6d24d2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:26,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2 2023-11-21 13:55:26,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2 2023-11-21 13:55:26,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-21 13:55:26,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for e72e2258c53c48d805ce683abe6d24d2 2023-11-21 13:55:26,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:55:26,040 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened e72e2258c53c48d805ce683abe6d24d2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68158823, jitterRate=0.01564560830593109}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-21 13:55:26,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for e72e2258c53c48d805ce683abe6d24d2: 2023-11-21 13:55:26,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2., pid=111, masterSystemTime=1700574925999 2023-11-21 13:55:26,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:26,042 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:26,042 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=e72e2258c53c48d805ce683abe6d24d2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:26,042 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700574926042"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574926042"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574926042"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574926042"}]},"ts":"1700574926042"} 2023-11-21 13:55:26,044 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=111, resume processing ppid=108 2023-11-21 13:55:26,044 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure e72e2258c53c48d805ce683abe6d24d2, server=jenkins-hbase6.apache.org,46365,1700574804408 in 195 msec 2023-11-21 13:55:26,045 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=108, resume processing ppid=105 2023-11-21 13:55:26,045 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=e72e2258c53c48d805ce683abe6d24d2, ASSIGN in 353 msec 2023-11-21 13:55:26,046 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-21 13:55:26,046 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574926046"}]},"ts":"1700574926046"} 2023-11-21 13:55:26,047 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-21 13:55:26,049 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-21 13:55:26,050 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1940 sec 2023-11-21 13:55:26,798 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/.tmp/family2/330854dc780c4d4595829f936583390b as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/330854dc780c4d4595829f936583390b 2023-11-21 13:55:26,800 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/.tmp/family2/e1effe4f45e64777b24c8442501f5fd9 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/e1effe4f45e64777b24c8442501f5fd9 2023-11-21 13:55:26,802 INFO [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in a3726db2a6d35a4ace20911e14a84575/family2 of a3726db2a6d35a4ace20911e14a84575 into 330854dc780c4d4595829f936583390b(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:55:26,802 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for a3726db2a6d35a4ace20911e14a84575: 2023-11-21 13:55:26,802 INFO [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575., storeName=a3726db2a6d35a4ace20911e14a84575/family2, priority=12, startTime=1700574923554; duration=0sec 2023-11-21 13:55:26,802 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-21 13:55:26,803 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-21 13:55:26,803 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-21 13:55:26,803 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-21 13:55:26,803 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. because compaction request was cancelled 2023-11-21 13:55:26,803 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-21 13:55:26,803 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-21 13:55:26,815 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-21 13:55:26,815 DEBUG [RS:0;jenkins-hbase6:46365-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. because compaction request was cancelled 2023-11-21 13:55:26,815 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 2c2220da91c79539696a8094984e331e/family2 of 2c2220da91c79539696a8094984e331e into e1effe4f45e64777b24c8442501f5fd9(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:55:26,815 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2c2220da91c79539696a8094984e331e: 2023-11-21 13:55:26,815 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e., storeName=2c2220da91c79539696a8094984e331e/family2, priority=12, startTime=1700574923507; duration=0sec 2023-11-21 13:55:26,815 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:55:26,816 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-21 13:55:26,816 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b793056 to 127.0.0.1:52369 2023-11-21 13:55:26,816 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:55:26,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-7cacaaa69f874133add2611b3499950e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-fe584384e451421e966c64b193ca6784, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-cc1e2abdb8b84b0a8e5b474cdb792e45, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-17d29f4adc654a13b4cada34bc7f4d31] to archive 2023-11-21 13:55:26,817 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-21 13:55:26,817 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0988f79d to 127.0.0.1:52369 2023-11-21 13:55:26,817 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:55:26,817 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-21 13:55:26,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:26,818 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x357c2d05 to 127.0.0.1:52369 2023-11-21 13:55:26,818 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:55:26,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-7cacaaa69f874133add2611b3499950e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-7cacaaa69f874133add2611b3499950e 2023-11-21 13:55:26,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-fe584384e451421e966c64b193ca6784 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-fe584384e451421e966c64b193ca6784 2023-11-21 13:55:26,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-cc1e2abdb8b84b0a8e5b474cdb792e45 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-cc1e2abdb8b84b0a8e5b474cdb792e45 2023-11-21 13:55:26,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-17d29f4adc654a13b4cada34bc7f4d31 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/family2/testCompactionWithHFileLink=a3726db2a6d35a4ace20911e14a84575-17d29f4adc654a13b4cada34bc7f4d31 2023-11-21 13:55:26,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-7669c129d1c947e2b93c80da48fe282d, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-9cefbb6708ea467c83688fd844c68bb7, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-8a0bfb9aaea443ce937260a1c1b4218b, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-7726f25dbada4e85a3299254e5fa012e] to archive 2023-11-21 13:55:26,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:26,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-7669c129d1c947e2b93c80da48fe282d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-7669c129d1c947e2b93c80da48fe282d 2023-11-21 13:55:26,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-9cefbb6708ea467c83688fd844c68bb7 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-9cefbb6708ea467c83688fd844c68bb7 2023-11-21 13:55:26,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-8a0bfb9aaea443ce937260a1c1b4218b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-8a0bfb9aaea443ce937260a1c1b4218b 2023-11-21 13:55:26,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-7726f25dbada4e85a3299254e5fa012e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/family2/testCompactionWithHFileLink=2c2220da91c79539696a8094984e331e-7726f25dbada4e85a3299254e5fa012e 2023-11-21 13:55:26,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-21 13:55:26,963 INFO [Listener at localhost/35077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-21 13:55:26,968 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:26,969 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:26,969 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:26,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:26,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-21 13:55:26,972 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-21 13:55:26,972 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:26,972 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-21 13:55:26,972 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-21 13:55:26,973 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:26,973 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:26,974 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:26,974 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:26,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:26,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:26,975 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:26,975 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:26,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:26,975 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:26,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:26,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:26,976 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-21 13:55:26,976 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-21 13:55:26,976 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-21 13:55:26,976 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:26,976 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-21 13:55:26,976 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:26,976 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:26,976 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. started... 2023-11-21 13:55:26,976 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:26,976 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-21 13:55:26,978 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:26,976 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. started... 2023-11-21 13:55:26,976 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. started... 2023-11-21 13:55:26,978 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e72e2258c53c48d805ce683abe6d24d2 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-21 13:55:26,978 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 25535f294975fa5548703e68e64b1bfc 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-21 13:55:26,978 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5cb093399d723625f3078fe0d10bdf3b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-21 13:55:27,393 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231121451e685336534db5a6127fe48f3c7633 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231121451e685336534db5a6127fe48f3c7633 2023-11-21 13:55:27,393 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231121595e24ed3b2248579526d864b037faf0 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231121595e24ed3b2248579526d864b037faf0 2023-11-21 13:55:27,393 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112196efe6c231944782b8833f5a19a7bd23 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112196efe6c231944782b8833f5a19a7bd23 2023-11-21 13:55:27,799 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family1/999691ab48cc4b2abd1e3f4fafb3b9f4 2023-11-21 13:55:27,799 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family1/94c2b5b7d796421db0da5a912abe3001 2023-11-21 13:55:27,799 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family1/bfb0b0f873774d4c9b1303fd13fe2ddd 2023-11-21 13:55:27,824 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231121aeae572684944cada3706889e5b8b333 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231121aeae572684944cada3706889e5b8b333 2023-11-21 13:55:28,221 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311217d03206dcbca43f2b9420df268ed2e6e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311217d03206dcbca43f2b9420df268ed2e6e 2023-11-21 13:55:28,223 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231121cf822b76033a47108c3a1c4629f8e598 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231121cf822b76033a47108c3a1c4629f8e598 2023-11-21 13:55:28,229 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family2/340d4f2a7ba24d58acb524474ef3f222 2023-11-21 13:55:28,232 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family1/94c2b5b7d796421db0da5a912abe3001 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/94c2b5b7d796421db0da5a912abe3001 2023-11-21 13:55:28,236 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/94c2b5b7d796421db0da5a912abe3001, entries=4, sequenceid=5, filesize=5.4 K 2023-11-21 13:55:28,236 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family2/340d4f2a7ba24d58acb524474ef3f222 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/340d4f2a7ba24d58acb524474ef3f222 2023-11-21 13:55:28,240 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/340d4f2a7ba24d58acb524474ef3f222, entries=2, sequenceid=5, filesize=5.1 K 2023-11-21 13:55:28,241 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 5cb093399d723625f3078fe0d10bdf3b in 1263ms, sequenceid=5, compaction requested=false 2023-11-21 13:55:28,241 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-21 13:55:28,241 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5cb093399d723625f3078fe0d10bdf3b: 2023-11-21 13:55:28,241 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:28,241 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-21 13:55:28,626 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family2/ac015c95a2b14b2db5b0c3ff22be4c94 2023-11-21 13:55:28,628 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family2/113985a539b34eeeaae0ae722dd4c601 2023-11-21 13:55:28,630 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family1/999691ab48cc4b2abd1e3f4fafb3b9f4 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/999691ab48cc4b2abd1e3f4fafb3b9f4 2023-11-21 13:55:28,632 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family1/bfb0b0f873774d4c9b1303fd13fe2ddd as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/bfb0b0f873774d4c9b1303fd13fe2ddd 2023-11-21 13:55:28,634 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/999691ab48cc4b2abd1e3f4fafb3b9f4, entries=4, sequenceid=5, filesize=5.4 K 2023-11-21 13:55:28,635 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family2/ac015c95a2b14b2db5b0c3ff22be4c94 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/ac015c95a2b14b2db5b0c3ff22be4c94 2023-11-21 13:55:28,635 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/bfb0b0f873774d4c9b1303fd13fe2ddd, entries=4, sequenceid=5, filesize=5.4 K 2023-11-21 13:55:28,636 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family2/113985a539b34eeeaae0ae722dd4c601 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/113985a539b34eeeaae0ae722dd4c601 2023-11-21 13:55:28,638 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/ac015c95a2b14b2db5b0c3ff22be4c94, entries=2, sequenceid=5, filesize=5.1 K 2023-11-21 13:55:28,639 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for e72e2258c53c48d805ce683abe6d24d2 in 1661ms, sequenceid=5, compaction requested=false 2023-11-21 13:55:28,640 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e72e2258c53c48d805ce683abe6d24d2: 2023-11-21 13:55:28,640 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:28,640 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-21 13:55:28,640 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/113985a539b34eeeaae0ae722dd4c601, entries=2, sequenceid=5, filesize=5.1 K 2023-11-21 13:55:28,641 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 25535f294975fa5548703e68e64b1bfc in 1663ms, sequenceid=5, compaction requested=false 2023-11-21 13:55:28,641 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 25535f294975fa5548703e68e64b1bfc: 2023-11-21 13:55:28,641 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:28,641 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-21 13:55:28,641 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-21 13:55:28,641 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:28,641 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-21 13:55:28,641 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-21 13:55:28,643 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:28,643 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:28,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:28,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:28,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:28,643 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:28,643 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:28,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:28,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:28,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:28,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:28,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:28,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-21 13:55:28,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b88679d[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:28,645 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-21 13:55:28,645 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:28,646 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:28,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:28,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:28,646 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-21 13:55:28,646 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-21 13:55:28,646 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:28,646 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:28,646 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:28,648 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:28,648 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-21 13:55:28,648 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:28,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:28,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:28,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:28,648 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-21 13:55:28,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:28,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:28,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:28,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:28,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:28,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:28,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:28,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:28,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-21 13:55:28,651 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-21 13:55:28,651 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:28,651 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:28,651 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-21 13:55:28,651 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:28,654 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:28,654 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:28,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:28,654 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:28,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:28,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:28,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:28,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:28,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:28,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:28,655 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:28,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:28,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:28,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:28,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:28,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:28,656 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:28,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:28,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:28,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:28,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:28,658 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:28,658 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:28,658 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:28,658 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:28,658 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:28,658 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:28,658 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:28,658 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:28,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-21 13:55:28,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:28,658 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:28,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:28,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:28,659 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:28,658 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:28,659 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:28,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:28,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:28,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-21 13:55:28,759 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:28,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:28,761 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:28,761 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:28,761 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:28,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:28,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:28,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-21 13:55:28,765 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-21 13:55:28,765 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:28,765 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-21 13:55:28,765 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-21 13:55:28,766 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:28,766 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:28,767 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:28,767 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:28,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:28,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:28,768 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:28,768 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:28,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:28,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:28,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:28,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:28,769 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-21 13:55:28,769 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-21 13:55:28,769 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-21 13:55:28,769 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-21 13:55:28,769 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:28,769 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-21 13:55:28,770 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-21 13:55:28,770 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:28,770 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:28,770 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. started... 2023-11-21 13:55:28,770 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:28,770 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. started... 2023-11-21 13:55:28,770 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. started... 2023-11-21 13:55:28,770 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:28,770 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5cb093399d723625f3078fe0d10bdf3b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-21 13:55:28,770 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 25535f294975fa5548703e68e64b1bfc 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-21 13:55:28,770 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e72e2258c53c48d805ce683abe6d24d2 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-21 13:55:28,788 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112172ecd49c14c3457d9219d605dc104516 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023112172ecd49c14c3457d9219d605dc104516 2023-11-21 13:55:29,190 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231121c3635745e7334573ba48ce193ef38f68 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231121c3635745e7334573ba48ce193ef38f68 2023-11-21 13:55:29,190 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231121c5c865e6483446ac9c6bc747c60a1abb to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231121c5c865e6483446ac9c6bc747c60a1abb 2023-11-21 13:55:29,195 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family1/74d8f4012d434cb8b46d22370cc7e2e2 2023-11-21 13:55:29,595 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family1/f2b4ebf70f7f4654bef130cc3ba8c67f 2023-11-21 13:55:29,595 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family1/f98c99154fb542b3862d41321f8b0a3d 2023-11-21 13:55:29,610 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311213912e6520a6c4ba4b057fd0eddd87e82 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311213912e6520a6c4ba4b057fd0eddd87e82 2023-11-21 13:55:30,021 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family2/902aacbbb02647bf9ade1812397d72d3 2023-11-21 13:55:30,023 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311213988f06fd6644dcfb869f723b68b56c0 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311213988f06fd6644dcfb869f723b68b56c0 2023-11-21 13:55:30,024 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311218a56593f622e4dd381b3f089ad7dc3f0 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311218a56593f622e4dd381b3f089ad7dc3f0 2023-11-21 13:55:30,025 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family1/74d8f4012d434cb8b46d22370cc7e2e2 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/74d8f4012d434cb8b46d22370cc7e2e2 2023-11-21 13:55:30,029 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/74d8f4012d434cb8b46d22370cc7e2e2, entries=4, sequenceid=9, filesize=5.4 K 2023-11-21 13:55:30,030 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family2/902aacbbb02647bf9ade1812397d72d3 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/902aacbbb02647bf9ade1812397d72d3 2023-11-21 13:55:30,033 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/902aacbbb02647bf9ade1812397d72d3, entries=2, sequenceid=9, filesize=5.1 K 2023-11-21 13:55:30,034 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for e72e2258c53c48d805ce683abe6d24d2 in 1264ms, sequenceid=9, compaction requested=false 2023-11-21 13:55:30,034 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e72e2258c53c48d805ce683abe6d24d2: 2023-11-21 13:55:30,034 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:30,034 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-21 13:55:30,039 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family2/c8b81c29648348c6bd8c9a8bf620aacc 2023-11-21 13:55:30,042 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family1/f98c99154fb542b3862d41321f8b0a3d as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/f98c99154fb542b3862d41321f8b0a3d 2023-11-21 13:55:30,046 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/f98c99154fb542b3862d41321f8b0a3d, entries=4, sequenceid=9, filesize=5.4 K 2023-11-21 13:55:30,047 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family2/c8b81c29648348c6bd8c9a8bf620aacc as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/c8b81c29648348c6bd8c9a8bf620aacc 2023-11-21 13:55:30,050 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/c8b81c29648348c6bd8c9a8bf620aacc, entries=2, sequenceid=9, filesize=5.1 K 2023-11-21 13:55:30,051 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 25535f294975fa5548703e68e64b1bfc in 1281ms, sequenceid=9, compaction requested=false 2023-11-21 13:55:30,051 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 25535f294975fa5548703e68e64b1bfc: 2023-11-21 13:55:30,051 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:30,051 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-21 13:55:30,439 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family2/e3aa153f906d4445a141469852f5b8c1 2023-11-21 13:55:30,444 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family1/f2b4ebf70f7f4654bef130cc3ba8c67f as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/f2b4ebf70f7f4654bef130cc3ba8c67f 2023-11-21 13:55:30,447 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/f2b4ebf70f7f4654bef130cc3ba8c67f, entries=4, sequenceid=9, filesize=5.4 K 2023-11-21 13:55:30,448 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family2/e3aa153f906d4445a141469852f5b8c1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/e3aa153f906d4445a141469852f5b8c1 2023-11-21 13:55:30,452 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/e3aa153f906d4445a141469852f5b8c1, entries=2, sequenceid=9, filesize=5.1 K 2023-11-21 13:55:30,453 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 5cb093399d723625f3078fe0d10bdf3b in 1683ms, sequenceid=9, compaction requested=false 2023-11-21 13:55:30,453 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5cb093399d723625f3078fe0d10bdf3b: 2023-11-21 13:55:30,453 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:30,453 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-21 13:55:30,453 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-21 13:55:30,453 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:30,453 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-21 13:55:30,453 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-21 13:55:30,455 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:30,455 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:30,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:30,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:30,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:30,455 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:30,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:30,456 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:30,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:30,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:30,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:30,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:30,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-21 13:55:30,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@750d1ad9[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:30,457 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-21 13:55:30,457 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:30,459 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:30,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:30,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:30,459 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-21 13:55:30,459 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-21 13:55:30,459 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:30,459 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:30,460 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:30,461 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-21 13:55:30,461 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:30,461 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:30,461 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-21 13:55:30,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:30,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:30,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:30,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:30,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:30,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:30,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:30,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:30,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:30,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:30,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:30,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-21 13:55:30,464 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-21 13:55:30,464 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:30,464 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:30,464 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-21 13:55:30,464 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:30,466 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:30,466 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:30,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:30,466 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:30,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:30,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:30,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:30,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:30,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:30,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:30,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:30,467 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:30,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:30,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:30,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:30,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:30,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:30,468 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:30,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:30,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:30,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:30,471 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:30,471 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:30,471 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:30,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:30,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:30,471 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:30,471 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:30,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-21 13:55:30,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:30,471 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:30,472 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:30,472 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:30,472 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:30,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:30,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:30,472 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:30,472 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:30,472 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:30,572 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:30,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:30,574 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:30,574 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:30,575 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:30,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:30,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:30,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-21 13:55:30,579 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-21 13:55:30,579 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:30,579 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-21 13:55:30,579 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-21 13:55:30,579 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:30,579 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:30,581 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:30,581 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:30,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:30,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:30,582 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:30,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:30,582 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:30,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:30,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:30,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:30,582 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-21 13:55:30,583 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-21 13:55:30,583 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-21 13:55:30,583 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-21 13:55:30,583 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:30,583 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-21 13:55:30,583 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:30,583 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:30,583 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:30,583 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. started... 2023-11-21 13:55:30,583 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. started... 2023-11-21 13:55:30,583 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-21 13:55:30,583 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:30,583 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5cb093399d723625f3078fe0d10bdf3b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-21 13:55:30,583 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. started... 2023-11-21 13:55:30,583 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e72e2258c53c48d805ce683abe6d24d2 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-21 13:55:30,584 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 25535f294975fa5548703e68e64b1bfc 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-21 13:55:30,606 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231121ae9d863826704791b96f82f46dcfd1c3 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231121ae9d863826704791b96f82f46dcfd1c3 2023-11-21 13:55:31,000 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311219b1d8872da8d4a73ba7c74698884e28d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311219b1d8872da8d4a73ba7c74698884e28d 2023-11-21 13:55:31,003 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112188fee480b3884e2c9aee82762acf0d1b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112188fee480b3884e2c9aee82762acf0d1b 2023-11-21 13:55:31,005 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family1/81d3093e1a5745bcbd12a28d0e729401 2023-11-21 13:55:31,015 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family1/35d6a2c06acf42418d51bbe49c87d6a1 2023-11-21 13:55:31,026 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311211c9c0efac51e4301947f051b4cc51a7f to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311211c9c0efac51e4301947f051b4cc51a7f 2023-11-21 13:55:31,408 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family1/3913bc4699794102abb9c7c1554d11f1 2023-11-21 13:55:31,418 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311217ebf59b4a71a44e0a016a9b9aaa7b105 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311217ebf59b4a71a44e0a016a9b9aaa7b105 2023-11-21 13:55:31,421 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311214139835db4b54f339b17035b960a1670 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311214139835db4b54f339b17035b960a1670 2023-11-21 13:55:31,422 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family2/b6b77222a4bd4e85a034ee4f4285ec6e 2023-11-21 13:55:31,426 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family1/81d3093e1a5745bcbd12a28d0e729401 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/81d3093e1a5745bcbd12a28d0e729401 2023-11-21 13:55:31,429 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/81d3093e1a5745bcbd12a28d0e729401, entries=4, sequenceid=13, filesize=5.4 K 2023-11-21 13:55:31,429 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family2/b6b77222a4bd4e85a034ee4f4285ec6e as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/b6b77222a4bd4e85a034ee4f4285ec6e 2023-11-21 13:55:31,430 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family2/177651bd491746b085b4b830dc8d3a3f 2023-11-21 13:55:31,433 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/b6b77222a4bd4e85a034ee4f4285ec6e, entries=2, sequenceid=13, filesize=5.1 K 2023-11-21 13:55:31,434 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for e72e2258c53c48d805ce683abe6d24d2 in 851ms, sequenceid=13, compaction requested=true 2023-11-21 13:55:31,434 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e72e2258c53c48d805ce683abe6d24d2: 2023-11-21 13:55:31,434 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family1/35d6a2c06acf42418d51bbe49c87d6a1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/35d6a2c06acf42418d51bbe49c87d6a1 2023-11-21 13:55:31,434 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:31,434 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-21 13:55:31,437 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/35d6a2c06acf42418d51bbe49c87d6a1, entries=4, sequenceid=13, filesize=5.4 K 2023-11-21 13:55:31,438 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family2/177651bd491746b085b4b830dc8d3a3f as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/177651bd491746b085b4b830dc8d3a3f 2023-11-21 13:55:31,441 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/177651bd491746b085b4b830dc8d3a3f, entries=2, sequenceid=13, filesize=5.1 K 2023-11-21 13:55:31,442 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 5cb093399d723625f3078fe0d10bdf3b in 859ms, sequenceid=13, compaction requested=true 2023-11-21 13:55:31,442 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5cb093399d723625f3078fe0d10bdf3b: 2023-11-21 13:55:31,442 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:31,442 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-21 13:55:31,503 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-21 13:55:31,826 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family2/4adacdbe1e3d46bd8e19da20cdcd2c3e 2023-11-21 13:55:31,830 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family1/3913bc4699794102abb9c7c1554d11f1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/3913bc4699794102abb9c7c1554d11f1 2023-11-21 13:55:31,833 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/3913bc4699794102abb9c7c1554d11f1, entries=4, sequenceid=13, filesize=5.4 K 2023-11-21 13:55:31,834 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family2/4adacdbe1e3d46bd8e19da20cdcd2c3e as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/4adacdbe1e3d46bd8e19da20cdcd2c3e 2023-11-21 13:55:31,837 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/4adacdbe1e3d46bd8e19da20cdcd2c3e, entries=2, sequenceid=13, filesize=5.1 K 2023-11-21 13:55:31,837 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 25535f294975fa5548703e68e64b1bfc in 1253ms, sequenceid=13, compaction requested=true 2023-11-21 13:55:31,838 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 25535f294975fa5548703e68e64b1bfc: 2023-11-21 13:55:31,838 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:31,838 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-21 13:55:31,838 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-21 13:55:31,838 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:31,838 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-21 13:55:31,838 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-21 13:55:31,840 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:31,840 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:31,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:31,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:31,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:31,840 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:31,840 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:31,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:31,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:31,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:31,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:31,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:31,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-21 13:55:31,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f75bf35[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:31,841 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-21 13:55:31,841 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:31,843 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:31,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:31,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:31,843 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-21 13:55:31,843 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-21 13:55:31,843 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:31,843 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:31,843 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:31,844 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-21 13:55:31,845 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:31,844 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:31,845 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-21 13:55:31,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:31,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:31,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:31,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:31,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:31,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:31,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:31,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:31,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:31,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:31,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:31,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-21 13:55:31,847 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-21 13:55:31,847 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:31,847 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:31,847 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-21 13:55:31,847 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:31,853 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:31,853 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:31,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:31,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:31,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:31,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:31,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:31,853 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:31,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:31,853 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:31,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:31,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:31,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:31,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:31,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:31,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:31,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:31,855 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:31,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:31,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:31,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:31,857 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:31,857 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:31,857 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:31,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:31,857 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:31,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-21 13:55:31,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:31,857 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:31,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:31,857 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:31,858 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:31,858 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:31,858 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:31,858 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:31,858 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:31,858 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:31,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:31,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:31,958 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:31,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:31,960 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:31,960 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:31,960 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:31,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:31,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:31,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-21 13:55:31,964 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-21 13:55:31,964 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:31,964 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-21 13:55:31,964 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-21 13:55:31,964 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:31,964 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:31,966 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:31,966 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:31,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:31,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:31,966 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:31,966 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:31,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:31,967 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:31,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:31,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:31,967 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-21 13:55:31,967 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-21 13:55:31,967 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-21 13:55:31,967 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-21 13:55:31,967 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:31,967 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-21 13:55:31,967 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:31,967 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. started... 2023-11-21 13:55:31,967 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:31,968 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:31,968 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e72e2258c53c48d805ce683abe6d24d2 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-21 13:55:31,968 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. started... 2023-11-21 13:55:31,967 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-21 13:55:31,968 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:31,968 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. started... 2023-11-21 13:55:31,968 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5cb093399d723625f3078fe0d10bdf3b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-21 13:55:31,968 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 25535f294975fa5548703e68e64b1bfc 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-21 13:55:32,381 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112171ed61af622c45188c97d8cc1e02d9e9 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023112171ed61af622c45188c97d8cc1e02d9e9 2023-11-21 13:55:32,381 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311210b69984b3d7f4f428e1d17998539b84e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311210b69984b3d7f4f428e1d17998539b84e 2023-11-21 13:55:32,381 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112155b6d59f01dc419c88b3105a498ffe39 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112155b6d59f01dc419c88b3105a498ffe39 2023-11-21 13:55:32,786 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family1/24065e20735c497faff39aff9362a796 2023-11-21 13:55:32,786 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family1/244810e342394ee49e21ef64d380ec7e 2023-11-21 13:55:32,786 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family1/8d294d5d9e534eefb0dca52298ece378 2023-11-21 13:55:33,202 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231121bd015d43baa4431b90d9f45bf8d8aedc to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231121bd015d43baa4431b90d9f45bf8d8aedc 2023-11-21 13:55:33,203 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112112e9adca07f546868dc8b1e7b8430ec7 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023112112e9adca07f546868dc8b1e7b8430ec7 2023-11-21 13:55:33,208 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family2/8569233bd3ec4a348984846875a2e914 2023-11-21 13:55:33,209 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311216b8ecaa861ad4ca995d33ef547c3349f to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311216b8ecaa861ad4ca995d33ef547c3349f 2023-11-21 13:55:33,212 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family1/8d294d5d9e534eefb0dca52298ece378 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/8d294d5d9e534eefb0dca52298ece378 2023-11-21 13:55:33,215 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/8d294d5d9e534eefb0dca52298ece378, entries=4, sequenceid=17, filesize=5.4 K 2023-11-21 13:55:33,216 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family2/8569233bd3ec4a348984846875a2e914 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/8569233bd3ec4a348984846875a2e914 2023-11-21 13:55:33,218 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/8569233bd3ec4a348984846875a2e914, entries=2, sequenceid=17, filesize=5.1 K 2023-11-21 13:55:33,219 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for e72e2258c53c48d805ce683abe6d24d2 in 1251ms, sequenceid=17, compaction requested=true 2023-11-21 13:55:33,219 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e72e2258c53c48d805ce683abe6d24d2: 2023-11-21 13:55:33,219 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:33,219 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-21 13:55:33,608 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family2/83964a0ca49f4d26af30b959b220675e 2023-11-21 13:55:33,612 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family1/24065e20735c497faff39aff9362a796 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/24065e20735c497faff39aff9362a796 2023-11-21 13:55:33,613 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family2/377ff3a30d8b4421a719a804d5159972 2023-11-21 13:55:33,616 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/24065e20735c497faff39aff9362a796, entries=4, sequenceid=17, filesize=5.4 K 2023-11-21 13:55:33,617 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family2/83964a0ca49f4d26af30b959b220675e as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/83964a0ca49f4d26af30b959b220675e 2023-11-21 13:55:33,617 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family1/244810e342394ee49e21ef64d380ec7e as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/244810e342394ee49e21ef64d380ec7e 2023-11-21 13:55:33,620 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/83964a0ca49f4d26af30b959b220675e, entries=2, sequenceid=17, filesize=5.1 K 2023-11-21 13:55:33,620 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/244810e342394ee49e21ef64d380ec7e, entries=4, sequenceid=17, filesize=5.4 K 2023-11-21 13:55:33,621 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 5cb093399d723625f3078fe0d10bdf3b in 1653ms, sequenceid=17, compaction requested=true 2023-11-21 13:55:33,621 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5cb093399d723625f3078fe0d10bdf3b: 2023-11-21 13:55:33,621 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:33,621 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-21 13:55:33,621 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family2/377ff3a30d8b4421a719a804d5159972 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/377ff3a30d8b4421a719a804d5159972 2023-11-21 13:55:33,624 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/377ff3a30d8b4421a719a804d5159972, entries=2, sequenceid=17, filesize=5.1 K 2023-11-21 13:55:33,625 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 25535f294975fa5548703e68e64b1bfc in 1657ms, sequenceid=17, compaction requested=true 2023-11-21 13:55:33,625 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 25535f294975fa5548703e68e64b1bfc: 2023-11-21 13:55:33,625 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:33,625 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-21 13:55:33,625 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-21 13:55:33,625 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:33,625 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-21 13:55:33,625 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-21 13:55:33,627 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:33,627 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:33,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:33,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:33,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:33,627 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:33,627 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:33,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:33,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:33,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:33,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:33,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:33,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-21 13:55:33,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19c78f2a[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:33,629 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-21 13:55:33,629 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:33,630 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:33,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:33,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:33,630 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-21 13:55:33,630 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-21 13:55:33,630 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:33,630 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:33,630 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:33,632 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-21 13:55:33,632 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:33,632 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:33,632 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-21 13:55:33,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:33,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:33,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:33,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:33,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:33,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:33,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:33,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:33,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-21 13:55:33,635 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-21 13:55:33,635 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:33,635 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:33,635 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-21 13:55:33,635 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:33,637 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:33,637 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:33,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:33,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:33,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:33,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:33,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:33,637 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:33,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:33,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:33,638 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:33,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:33,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:33,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:33,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:33,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:33,639 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:33,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:33,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:33,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:33,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:33,642 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:33,642 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:33,642 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:33,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:33,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-21 13:55:33,642 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:33,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-21 13:55:33,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:33,642 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:33,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:33,642 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:33,642 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:33,642 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:33,642 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:33,642 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:33,642 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:33,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:33,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:33,642 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:33,743 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:33,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:33,755 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:55:33,765 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:55:33,773 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:55:33,774 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:55:33,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:33,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:33,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-21 13:55:33,800 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-21 13:55:33,800 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:33,800 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-21 13:55:33,800 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-21 13:55:33,801 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:33,801 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:33,802 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:33,802 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:33,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:33,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:33,802 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:33,802 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:33,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:33,803 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:33,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:33,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:33,803 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-21 13:55:33,803 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-21 13:55:33,803 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-21 13:55:33,803 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-21 13:55:33,804 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:33,804 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-21 13:55:33,804 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:33,804 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. started... 2023-11-21 13:55:33,804 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-21 13:55:33,804 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:33,804 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:33,804 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:33,804 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. started... 2023-11-21 13:55:33,804 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e72e2258c53c48d805ce683abe6d24d2 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-21 13:55:33,804 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. started... 2023-11-21 13:55:33,804 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5cb093399d723625f3078fe0d10bdf3b 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-21 13:55:33,804 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 25535f294975fa5548703e68e64b1bfc 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-21 13:55:34,626 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family1/35a65d15276b423e802a0223d4e08144 2023-11-21 13:55:34,627 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family1/a11fd2a6da4a49c0b9403d621e660841 2023-11-21 13:55:34,627 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family1/687f07da5d4b401cbc0f4db03c46cdbf 2023-11-21 13:55:34,631 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35a65d15276b423e802a0223d4e08144 2023-11-21 13:55:34,631 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 687f07da5d4b401cbc0f4db03c46cdbf 2023-11-21 13:55:34,632 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a11fd2a6da4a49c0b9403d621e660841 2023-11-21 13:55:35,044 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family2/2626cbe6f7d84c2f863fbb9538c70912 2023-11-21 13:55:35,047 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2626cbe6f7d84c2f863fbb9538c70912 2023-11-21 13:55:35,048 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family1/a11fd2a6da4a49c0b9403d621e660841 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/a11fd2a6da4a49c0b9403d621e660841 2023-11-21 13:55:35,051 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a11fd2a6da4a49c0b9403d621e660841 2023-11-21 13:55:35,052 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/a11fd2a6da4a49c0b9403d621e660841, entries=3, sequenceid=23, filesize=5.0 K 2023-11-21 13:55:35,052 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family2/2626cbe6f7d84c2f863fbb9538c70912 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/2626cbe6f7d84c2f863fbb9538c70912 2023-11-21 13:55:35,055 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2626cbe6f7d84c2f863fbb9538c70912 2023-11-21 13:55:35,055 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/2626cbe6f7d84c2f863fbb9538c70912, entries=1, sequenceid=23, filesize=5.0 K 2023-11-21 13:55:35,056 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 25535f294975fa5548703e68e64b1bfc in 1252ms, sequenceid=23, compaction requested=true 2023-11-21 13:55:35,056 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 25535f294975fa5548703e68e64b1bfc: 2023-11-21 13:55:35,056 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:35,056 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-21 13:55:35,443 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family2/3bf7860300da47539305ffd002f337d5 2023-11-21 13:55:35,445 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family2/421f89142b674a0697de4b83317923ae 2023-11-21 13:55:35,447 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bf7860300da47539305ffd002f337d5 2023-11-21 13:55:35,448 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family1/35a65d15276b423e802a0223d4e08144 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/35a65d15276b423e802a0223d4e08144 2023-11-21 13:55:35,448 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 421f89142b674a0697de4b83317923ae 2023-11-21 13:55:35,449 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family1/687f07da5d4b401cbc0f4db03c46cdbf as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/687f07da5d4b401cbc0f4db03c46cdbf 2023-11-21 13:55:35,451 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35a65d15276b423e802a0223d4e08144 2023-11-21 13:55:35,451 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/35a65d15276b423e802a0223d4e08144, entries=3, sequenceid=23, filesize=5.0 K 2023-11-21 13:55:35,452 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family2/3bf7860300da47539305ffd002f337d5 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/3bf7860300da47539305ffd002f337d5 2023-11-21 13:55:35,452 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 687f07da5d4b401cbc0f4db03c46cdbf 2023-11-21 13:55:35,452 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/687f07da5d4b401cbc0f4db03c46cdbf, entries=3, sequenceid=23, filesize=5.0 K 2023-11-21 13:55:35,453 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family2/421f89142b674a0697de4b83317923ae as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/421f89142b674a0697de4b83317923ae 2023-11-21 13:55:35,456 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bf7860300da47539305ffd002f337d5 2023-11-21 13:55:35,456 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/3bf7860300da47539305ffd002f337d5, entries=1, sequenceid=23, filesize=5.0 K 2023-11-21 13:55:35,456 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 5cb093399d723625f3078fe0d10bdf3b in 1652ms, sequenceid=23, compaction requested=true 2023-11-21 13:55:35,456 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5cb093399d723625f3078fe0d10bdf3b: 2023-11-21 13:55:35,457 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:35,457 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-21 13:55:35,457 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 421f89142b674a0697de4b83317923ae 2023-11-21 13:55:35,457 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/421f89142b674a0697de4b83317923ae, entries=1, sequenceid=23, filesize=5.0 K 2023-11-21 13:55:35,458 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for e72e2258c53c48d805ce683abe6d24d2 in 1654ms, sequenceid=23, compaction requested=true 2023-11-21 13:55:35,458 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e72e2258c53c48d805ce683abe6d24d2: 2023-11-21 13:55:35,458 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:35,458 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-21 13:55:35,458 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-21 13:55:35,458 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:35,458 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-21 13:55:35,458 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-21 13:55:35,460 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:35,460 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:35,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:35,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:35,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:35,461 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:35,461 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:35,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:35,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:35,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:35,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:35,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:35,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-21 13:55:35,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@214bb700[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:35,462 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-21 13:55:35,462 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:35,467 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:35,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:35,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:35,467 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-21 13:55:35,467 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-21 13:55:35,467 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:35,467 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:35,467 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:35,468 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:35,469 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-21 13:55:35,469 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:35,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:35,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:35,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:35,469 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-21 13:55:35,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:35,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:35,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:35,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:35,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:35,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:35,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:35,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-21 13:55:35,471 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-21 13:55:35,471 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:35,471 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:35,471 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-21 13:55:35,471 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:35,476 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:35,476 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:35,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:35,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:35,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:35,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:35,476 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:35,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:35,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:35,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:35,477 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:35,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:35,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:35,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:35,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:35,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:35,478 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:35,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:35,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:35,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-21 13:55:35,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:35,480 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:35,480 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:35,481 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-21 13:55:35,481 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:35,481 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:35,481 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-21 13:55:35,481 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:35,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-21 13:55:35,481 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:35,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-21 13:55:35,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:35,481 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-21 13:55:35,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:35,481 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:35,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:35,481 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:35,481 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:35,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:35,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:35,581 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:35,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:35,582 DEBUG [Listener at localhost/35077] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:55:35,583 DEBUG [Listener at localhost/35077] regionserver.HStore(1912): e72e2258c53c48d805ce683abe6d24d2/family1 is initiating major compaction (all files) 2023-11-21 13:55:35,583 INFO [Listener at localhost/35077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:55:35,583 INFO [Listener at localhost/35077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:55:35,583 INFO [Listener at localhost/35077] regionserver.HRegion(2259): Starting compaction of e72e2258c53c48d805ce683abe6d24d2/family1 in ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:35,583 INFO [Listener at localhost/35077] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/999691ab48cc4b2abd1e3f4fafb3b9f4, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/74d8f4012d434cb8b46d22370cc7e2e2, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/81d3093e1a5745bcbd12a28d0e729401, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/8d294d5d9e534eefb0dca52298ece378, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/687f07da5d4b401cbc0f4db03c46cdbf] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp, totalSize=26.6 K 2023-11-21 13:55:35,584 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 999691ab48cc4b2abd1e3f4fafb3b9f4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574926969 2023-11-21 13:55:35,584 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 74d8f4012d434cb8b46d22370cc7e2e2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574928761 2023-11-21 13:55:35,585 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 81d3093e1a5745bcbd12a28d0e729401, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574930575 2023-11-21 13:55:35,585 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 8d294d5d9e534eefb0dca52298ece378, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574931960 2023-11-21 13:55:35,586 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 687f07da5d4b401cbc0f4db03c46cdbf, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-21 13:55:35,595 INFO [Listener at localhost/35077] throttle.PressureAwareThroughputController(145): e72e2258c53c48d805ce683abe6d24d2#family1#compaction#150 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:55:36,003 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231121d8bfd65b6afc49eab00210e143b72c65_del 2023-11-21 13:55:36,004 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231121d8bfd65b6afc49eab00210e143b72c65_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231121d8bfd65b6afc49eab00210e143b72c65_del 2023-11-21 13:55:36,817 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1427a913762d40a2881c6855408b8b5e 2023-11-21 13:55:36,818 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family1/1427a913762d40a2881c6855408b8b5e as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/1427a913762d40a2881c6855408b8b5e 2023-11-21 13:55:36,821 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1427a913762d40a2881c6855408b8b5e 2023-11-21 13:55:36,822 INFO [Listener at localhost/35077] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e72e2258c53c48d805ce683abe6d24d2/family1 of e72e2258c53c48d805ce683abe6d24d2 into 1427a913762d40a2881c6855408b8b5e(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-21 13:55:36,822 DEBUG [Listener at localhost/35077] regionserver.HRegion(2289): Compaction status journal for e72e2258c53c48d805ce683abe6d24d2: 2023-11-21 13:55:36,822 DEBUG [Listener at localhost/35077] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:55:36,822 DEBUG [Listener at localhost/35077] regionserver.HStore(1912): e72e2258c53c48d805ce683abe6d24d2/family2 is initiating major compaction (all files) 2023-11-21 13:55:36,822 INFO [Listener at localhost/35077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:55:36,822 INFO [Listener at localhost/35077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:55:36,823 INFO [Listener at localhost/35077] regionserver.HRegion(2259): Starting compaction of e72e2258c53c48d805ce683abe6d24d2/family2 in ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:55:36,823 INFO [Listener at localhost/35077] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/ac015c95a2b14b2db5b0c3ff22be4c94, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/902aacbbb02647bf9ade1812397d72d3, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/b6b77222a4bd4e85a034ee4f4285ec6e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/8569233bd3ec4a348984846875a2e914, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/421f89142b674a0697de4b83317923ae] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp, totalSize=25.3 K 2023-11-21 13:55:36,823 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting ac015c95a2b14b2db5b0c3ff22be4c94, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574926969 2023-11-21 13:55:36,824 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 902aacbbb02647bf9ade1812397d72d3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574928761 2023-11-21 13:55:36,824 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting b6b77222a4bd4e85a034ee4f4285ec6e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574930575 2023-11-21 13:55:36,824 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 8569233bd3ec4a348984846875a2e914, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574931960 2023-11-21 13:55:36,825 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 421f89142b674a0697de4b83317923ae, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-21 13:55:36,832 INFO [Listener at localhost/35077] throttle.PressureAwareThroughputController(145): e72e2258c53c48d805ce683abe6d24d2#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:55:36,919 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/999691ab48cc4b2abd1e3f4fafb3b9f4, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/74d8f4012d434cb8b46d22370cc7e2e2, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/81d3093e1a5745bcbd12a28d0e729401, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/8d294d5d9e534eefb0dca52298ece378, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/687f07da5d4b401cbc0f4db03c46cdbf] to archive 2023-11-21 13:55:36,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:36,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/999691ab48cc4b2abd1e3f4fafb3b9f4 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/999691ab48cc4b2abd1e3f4fafb3b9f4 2023-11-21 13:55:36,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/74d8f4012d434cb8b46d22370cc7e2e2 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/74d8f4012d434cb8b46d22370cc7e2e2 2023-11-21 13:55:36,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/81d3093e1a5745bcbd12a28d0e729401 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/81d3093e1a5745bcbd12a28d0e729401 2023-11-21 13:55:36,925 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/8d294d5d9e534eefb0dca52298ece378 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/8d294d5d9e534eefb0dca52298ece378 2023-11-21 13:55:36,926 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/687f07da5d4b401cbc0f4db03c46cdbf to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/687f07da5d4b401cbc0f4db03c46cdbf 2023-11-21 13:55:37,241 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023112160bd82715a324d7bbecb9cb3f04ca734_del 2023-11-21 13:55:37,241 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112160bd82715a324d7bbecb9cb3f04ca734_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023112160bd82715a324d7bbecb9cb3f04ca734_del 2023-11-21 13:55:38,053 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77304d32f5964987a2637051426bd9d6 2023-11-21 13:55:38,054 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/.tmp/family2/77304d32f5964987a2637051426bd9d6 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/77304d32f5964987a2637051426bd9d6 2023-11-21 13:55:38,057 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77304d32f5964987a2637051426bd9d6 2023-11-21 13:55:38,058 INFO [Listener at localhost/35077] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e72e2258c53c48d805ce683abe6d24d2/family2 of e72e2258c53c48d805ce683abe6d24d2 into 77304d32f5964987a2637051426bd9d6(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-21 13:55:38,058 DEBUG [Listener at localhost/35077] regionserver.HRegion(2289): Compaction status journal for e72e2258c53c48d805ce683abe6d24d2: 2023-11-21 13:55:38,059 DEBUG [Listener at localhost/35077] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:55:38,059 DEBUG [Listener at localhost/35077] regionserver.HStore(1912): 25535f294975fa5548703e68e64b1bfc/family1 is initiating major compaction (all files) 2023-11-21 13:55:38,059 INFO [Listener at localhost/35077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:55:38,059 INFO [Listener at localhost/35077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:55:38,059 INFO [Listener at localhost/35077] regionserver.HRegion(2259): Starting compaction of 25535f294975fa5548703e68e64b1bfc/family1 in ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:38,059 INFO [Listener at localhost/35077] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/bfb0b0f873774d4c9b1303fd13fe2ddd, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/f98c99154fb542b3862d41321f8b0a3d, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/3913bc4699794102abb9c7c1554d11f1, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/244810e342394ee49e21ef64d380ec7e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/a11fd2a6da4a49c0b9403d621e660841] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp, totalSize=26.6 K 2023-11-21 13:55:38,060 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting bfb0b0f873774d4c9b1303fd13fe2ddd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574926968 2023-11-21 13:55:38,060 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting f98c99154fb542b3862d41321f8b0a3d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574928761 2023-11-21 13:55:38,060 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 3913bc4699794102abb9c7c1554d11f1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574930574 2023-11-21 13:55:38,061 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 244810e342394ee49e21ef64d380ec7e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574931960 2023-11-21 13:55:38,061 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting a11fd2a6da4a49c0b9403d621e660841, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-21 13:55:38,072 INFO [Listener at localhost/35077] throttle.PressureAwareThroughputController(145): 25535f294975fa5548703e68e64b1bfc#family1#compaction#152 average throughput is 0.41 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:55:38,083 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311215a77fa57e5194967ac99118073c0002d_del 2023-11-21 13:55:38,083 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311215a77fa57e5194967ac99118073c0002d_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311215a77fa57e5194967ac99118073c0002d_del 2023-11-21 13:55:38,114 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/ac015c95a2b14b2db5b0c3ff22be4c94, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/902aacbbb02647bf9ade1812397d72d3, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/b6b77222a4bd4e85a034ee4f4285ec6e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/8569233bd3ec4a348984846875a2e914, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/421f89142b674a0697de4b83317923ae] to archive 2023-11-21 13:55:38,114 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:38,116 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/ac015c95a2b14b2db5b0c3ff22be4c94 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/ac015c95a2b14b2db5b0c3ff22be4c94 2023-11-21 13:55:38,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/902aacbbb02647bf9ade1812397d72d3 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/902aacbbb02647bf9ade1812397d72d3 2023-11-21 13:55:38,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/b6b77222a4bd4e85a034ee4f4285ec6e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/b6b77222a4bd4e85a034ee4f4285ec6e 2023-11-21 13:55:38,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/8569233bd3ec4a348984846875a2e914 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/8569233bd3ec4a348984846875a2e914 2023-11-21 13:55:38,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/421f89142b674a0697de4b83317923ae to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family2/421f89142b674a0697de4b83317923ae 2023-11-21 13:55:38,897 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 371e24ed8e414d9b92808b692d9df88b 2023-11-21 13:55:38,898 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family1/371e24ed8e414d9b92808b692d9df88b as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/371e24ed8e414d9b92808b692d9df88b 2023-11-21 13:55:38,901 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 371e24ed8e414d9b92808b692d9df88b 2023-11-21 13:55:38,902 INFO [Listener at localhost/35077] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 25535f294975fa5548703e68e64b1bfc/family1 of 25535f294975fa5548703e68e64b1bfc into 371e24ed8e414d9b92808b692d9df88b(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:55:38,902 DEBUG [Listener at localhost/35077] regionserver.HRegion(2289): Compaction status journal for 25535f294975fa5548703e68e64b1bfc: 2023-11-21 13:55:38,903 DEBUG [Listener at localhost/35077] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:55:38,903 DEBUG [Listener at localhost/35077] regionserver.HStore(1912): 25535f294975fa5548703e68e64b1bfc/family2 is initiating major compaction (all files) 2023-11-21 13:55:38,903 INFO [Listener at localhost/35077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:55:38,903 INFO [Listener at localhost/35077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:55:38,903 INFO [Listener at localhost/35077] regionserver.HRegion(2259): Starting compaction of 25535f294975fa5548703e68e64b1bfc/family2 in ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:55:38,903 INFO [Listener at localhost/35077] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/113985a539b34eeeaae0ae722dd4c601, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/c8b81c29648348c6bd8c9a8bf620aacc, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/4adacdbe1e3d46bd8e19da20cdcd2c3e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/377ff3a30d8b4421a719a804d5159972, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/2626cbe6f7d84c2f863fbb9538c70912] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp, totalSize=25.3 K 2023-11-21 13:55:38,903 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 113985a539b34eeeaae0ae722dd4c601, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574926968 2023-11-21 13:55:38,904 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting c8b81c29648348c6bd8c9a8bf620aacc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574928761 2023-11-21 13:55:38,904 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 4adacdbe1e3d46bd8e19da20cdcd2c3e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574930574 2023-11-21 13:55:38,904 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 377ff3a30d8b4421a719a804d5159972, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574931960 2023-11-21 13:55:38,905 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 2626cbe6f7d84c2f863fbb9538c70912, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-21 13:55:38,912 INFO [Listener at localhost/35077] throttle.PressureAwareThroughputController(145): 25535f294975fa5548703e68e64b1bfc#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:55:38,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/bfb0b0f873774d4c9b1303fd13fe2ddd, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/f98c99154fb542b3862d41321f8b0a3d, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/3913bc4699794102abb9c7c1554d11f1, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/244810e342394ee49e21ef64d380ec7e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/a11fd2a6da4a49c0b9403d621e660841] to archive 2023-11-21 13:55:38,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:38,916 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/bfb0b0f873774d4c9b1303fd13fe2ddd to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/bfb0b0f873774d4c9b1303fd13fe2ddd 2023-11-21 13:55:38,917 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/f98c99154fb542b3862d41321f8b0a3d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/f98c99154fb542b3862d41321f8b0a3d 2023-11-21 13:55:38,918 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/3913bc4699794102abb9c7c1554d11f1 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/3913bc4699794102abb9c7c1554d11f1 2023-11-21 13:55:38,919 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/244810e342394ee49e21ef64d380ec7e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/244810e342394ee49e21ef64d380ec7e 2023-11-21 13:55:38,919 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/a11fd2a6da4a49c0b9403d621e660841 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/a11fd2a6da4a49c0b9403d621e660841 2023-11-21 13:55:39,319 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231121bf9d60f153fc402e81ea35f6b1d4b5e2_del 2023-11-21 13:55:39,319 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231121bf9d60f153fc402e81ea35f6b1d4b5e2_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231121bf9d60f153fc402e81ea35f6b1d4b5e2_del 2023-11-21 13:55:40,133 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f1180c652ee49518657b9fb37074648 2023-11-21 13:55:40,134 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/.tmp/family2/1f1180c652ee49518657b9fb37074648 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/1f1180c652ee49518657b9fb37074648 2023-11-21 13:55:40,137 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f1180c652ee49518657b9fb37074648 2023-11-21 13:55:40,138 INFO [Listener at localhost/35077] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 25535f294975fa5548703e68e64b1bfc/family2 of 25535f294975fa5548703e68e64b1bfc into 1f1180c652ee49518657b9fb37074648(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-21 13:55:40,138 DEBUG [Listener at localhost/35077] regionserver.HRegion(2289): Compaction status journal for 25535f294975fa5548703e68e64b1bfc: 2023-11-21 13:55:40,138 DEBUG [Listener at localhost/35077] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:55:40,138 DEBUG [Listener at localhost/35077] regionserver.HStore(1912): 5cb093399d723625f3078fe0d10bdf3b/family1 is initiating major compaction (all files) 2023-11-21 13:55:40,138 INFO [Listener at localhost/35077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:55:40,138 INFO [Listener at localhost/35077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:55:40,139 INFO [Listener at localhost/35077] regionserver.HRegion(2259): Starting compaction of 5cb093399d723625f3078fe0d10bdf3b/family1 in ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:40,139 INFO [Listener at localhost/35077] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/94c2b5b7d796421db0da5a912abe3001, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/f2b4ebf70f7f4654bef130cc3ba8c67f, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/35d6a2c06acf42418d51bbe49c87d6a1, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/24065e20735c497faff39aff9362a796, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/35a65d15276b423e802a0223d4e08144] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp, totalSize=26.6 K 2023-11-21 13:55:40,139 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 94c2b5b7d796421db0da5a912abe3001, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574926969 2023-11-21 13:55:40,139 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting f2b4ebf70f7f4654bef130cc3ba8c67f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574928761 2023-11-21 13:55:40,140 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 35d6a2c06acf42418d51bbe49c87d6a1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574930574 2023-11-21 13:55:40,140 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 24065e20735c497faff39aff9362a796, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574931960 2023-11-21 13:55:40,140 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 35a65d15276b423e802a0223d4e08144, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-21 13:55:40,149 INFO [Listener at localhost/35077] throttle.PressureAwareThroughputController(145): 5cb093399d723625f3078fe0d10bdf3b#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:55:40,218 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/113985a539b34eeeaae0ae722dd4c601, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/c8b81c29648348c6bd8c9a8bf620aacc, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/4adacdbe1e3d46bd8e19da20cdcd2c3e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/377ff3a30d8b4421a719a804d5159972, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/2626cbe6f7d84c2f863fbb9538c70912] to archive 2023-11-21 13:55:40,219 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:40,221 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/113985a539b34eeeaae0ae722dd4c601 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/113985a539b34eeeaae0ae722dd4c601 2023-11-21 13:55:40,222 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/c8b81c29648348c6bd8c9a8bf620aacc to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/c8b81c29648348c6bd8c9a8bf620aacc 2023-11-21 13:55:40,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/4adacdbe1e3d46bd8e19da20cdcd2c3e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/4adacdbe1e3d46bd8e19da20cdcd2c3e 2023-11-21 13:55:40,225 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/377ff3a30d8b4421a719a804d5159972 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/377ff3a30d8b4421a719a804d5159972 2023-11-21 13:55:40,226 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/2626cbe6f7d84c2f863fbb9538c70912 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family2/2626cbe6f7d84c2f863fbb9538c70912 2023-11-21 13:55:40,557 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231121b68344ff263b40ab8e80b870a205b78f_del 2023-11-21 13:55:40,557 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231121b68344ff263b40ab8e80b870a205b78f_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231121b68344ff263b40ab8e80b870a205b78f_del 2023-11-21 13:55:40,970 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8cb4a212ada44ca1aa40b555f15397b0 2023-11-21 13:55:40,971 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family1/8cb4a212ada44ca1aa40b555f15397b0 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/8cb4a212ada44ca1aa40b555f15397b0 2023-11-21 13:55:40,974 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8cb4a212ada44ca1aa40b555f15397b0 2023-11-21 13:55:40,975 INFO [Listener at localhost/35077] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5cb093399d723625f3078fe0d10bdf3b/family1 of 5cb093399d723625f3078fe0d10bdf3b into 8cb4a212ada44ca1aa40b555f15397b0(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:55:40,975 DEBUG [Listener at localhost/35077] regionserver.HRegion(2289): Compaction status journal for 5cb093399d723625f3078fe0d10bdf3b: 2023-11-21 13:55:40,975 DEBUG [Listener at localhost/35077] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:55:40,975 DEBUG [Listener at localhost/35077] regionserver.HStore(1912): 5cb093399d723625f3078fe0d10bdf3b/family2 is initiating major compaction (all files) 2023-11-21 13:55:40,975 INFO [Listener at localhost/35077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:55:40,975 INFO [Listener at localhost/35077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:55:40,975 INFO [Listener at localhost/35077] regionserver.HRegion(2259): Starting compaction of 5cb093399d723625f3078fe0d10bdf3b/family2 in ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:55:40,975 INFO [Listener at localhost/35077] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/340d4f2a7ba24d58acb524474ef3f222, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/e3aa153f906d4445a141469852f5b8c1, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/177651bd491746b085b4b830dc8d3a3f, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/83964a0ca49f4d26af30b959b220675e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/3bf7860300da47539305ffd002f337d5] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp, totalSize=25.3 K 2023-11-21 13:55:40,976 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 340d4f2a7ba24d58acb524474ef3f222, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574926969 2023-11-21 13:55:40,976 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting e3aa153f906d4445a141469852f5b8c1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574928761 2023-11-21 13:55:40,976 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 177651bd491746b085b4b830dc8d3a3f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574930574 2023-11-21 13:55:40,976 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 83964a0ca49f4d26af30b959b220675e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574931960 2023-11-21 13:55:40,977 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 3bf7860300da47539305ffd002f337d5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-21 13:55:40,984 INFO [Listener at localhost/35077] throttle.PressureAwareThroughputController(145): 5cb093399d723625f3078fe0d10bdf3b#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:55:41,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/94c2b5b7d796421db0da5a912abe3001, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/f2b4ebf70f7f4654bef130cc3ba8c67f, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/35d6a2c06acf42418d51bbe49c87d6a1, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/24065e20735c497faff39aff9362a796, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/35a65d15276b423e802a0223d4e08144] to archive 2023-11-21 13:55:41,015 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:41,016 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/94c2b5b7d796421db0da5a912abe3001 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/94c2b5b7d796421db0da5a912abe3001 2023-11-21 13:55:41,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/f2b4ebf70f7f4654bef130cc3ba8c67f to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/f2b4ebf70f7f4654bef130cc3ba8c67f 2023-11-21 13:55:41,018 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/35d6a2c06acf42418d51bbe49c87d6a1 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/35d6a2c06acf42418d51bbe49c87d6a1 2023-11-21 13:55:41,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/24065e20735c497faff39aff9362a796 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/24065e20735c497faff39aff9362a796 2023-11-21 13:55:41,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/35a65d15276b423e802a0223d4e08144 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/35a65d15276b423e802a0223d4e08144 2023-11-21 13:55:41,392 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311211b6013272be648bda608aa0dbcb64332_del 2023-11-21 13:55:41,392 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311211b6013272be648bda608aa0dbcb64332_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311211b6013272be648bda608aa0dbcb64332_del 2023-11-21 13:55:41,806 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6df5d009dbf4431dadc1b8addb9a7ba9 2023-11-21 13:55:41,806 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/.tmp/family2/6df5d009dbf4431dadc1b8addb9a7ba9 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/6df5d009dbf4431dadc1b8addb9a7ba9 2023-11-21 13:55:41,809 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6df5d009dbf4431dadc1b8addb9a7ba9 2023-11-21 13:55:41,810 INFO [Listener at localhost/35077] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5cb093399d723625f3078fe0d10bdf3b/family2 of 5cb093399d723625f3078fe0d10bdf3b into 6df5d009dbf4431dadc1b8addb9a7ba9(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:55:41,810 DEBUG [Listener at localhost/35077] regionserver.HRegion(2289): Compaction status journal for 5cb093399d723625f3078fe0d10bdf3b: 2023-11-21 13:55:41,814 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:55:41,816 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:55:41,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/340d4f2a7ba24d58acb524474ef3f222, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/e3aa153f906d4445a141469852f5b8c1, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/177651bd491746b085b4b830dc8d3a3f, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/83964a0ca49f4d26af30b959b220675e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/3bf7860300da47539305ffd002f337d5] to archive 2023-11-21 13:55:41,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:41,820 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:55:41,820 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:55:41,822 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/340d4f2a7ba24d58acb524474ef3f222 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/340d4f2a7ba24d58acb524474ef3f222 2023-11-21 13:55:41,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/e3aa153f906d4445a141469852f5b8c1 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/e3aa153f906d4445a141469852f5b8c1 2023-11-21 13:55:41,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/177651bd491746b085b4b830dc8d3a3f to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/177651bd491746b085b4b830dc8d3a3f 2023-11-21 13:55:41,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/83964a0ca49f4d26af30b959b220675e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/83964a0ca49f4d26af30b959b220675e 2023-11-21 13:55:41,827 INFO [Listener at localhost/35077] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-21 13:55:41,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/3bf7860300da47539305ffd002f337d5 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family2/3bf7860300da47539305ffd002f337d5 2023-11-21 13:55:41,843 INFO [Listener at localhost/35077] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-21 13:55:41,845 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311215a77fa57e5194967ac99118073c0002d_del 2023-11-21 13:55:41,848 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231121b68344ff263b40ab8e80b870a205b78f_del 2023-11-21 13:55:41,851 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231121d8bfd65b6afc49eab00210e143b72c65_del 2023-11-21 13:55:41,851 INFO [Listener at localhost/35077] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-21 13:55:41,852 DEBUG [Listener at localhost/35077] zookeeper.ReadOnlyZKClient(139): Connect 0x1606c065 to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:55:41,856 DEBUG [Listener at localhost/35077] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d82cb09, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:55:41,858 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231121 for table='ns:testMinorCompaction' and column='family1' 2023-11-21 13:55:41,858 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231121 for table='ns:testMinorCompaction' and column='family1' 2023-11-21 13:55:41,858 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231121 for table='ns:testMinorCompaction' and column='family1' 2023-11-21 13:55:42,293 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231121440e96c14da5490e9d1f3de84c637490 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231121440e96c14da5490e9d1f3de84c637490 2023-11-21 13:55:42,294 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231121 table='ns:testMinorCompaction' column='family1' 2023-11-21 13:55:42,306 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:55:42,309 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:56026, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:55:42,316 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-21 13:55:42,323 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:49934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-21 13:55:42,334 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231121/family1/35da0bc9c08d42369587e0a0ade7d468 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-21 13:55:42,335 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231121/family1/35da0bc9c08d42369587e0a0ade7d468}] 2023-11-21 13:55:42,340 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231121/family1/35da0bc9c08d42369587e0a0ade7d468 for inclusion in e72e2258c53c48d805ce683abe6d24d2/family1 2023-11-21 13:55:42,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-21 13:55:42,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-21 13:55:42,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for e72e2258c53c48d805ce683abe6d24d2: 2023-11-21 13:55:42,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231121/family1/35da0bc9c08d42369587e0a0ade7d468 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__ns_testMinorCompaction__7fip77clolbakb20vp6c08c4gnlo7mdn5iolpaip5eteepe1u024r38i1drsc7o4/family1/35da0bc9c08d42369587e0a0ade7d468 2023-11-21 13:55:42,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__ns_testMinorCompaction__7fip77clolbakb20vp6c08c4gnlo7mdn5iolpaip5eteepe1u024r38i1drsc7o4/family1/35da0bc9c08d42369587e0a0ade7d468 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/85213fce9f854b8db9c825ddc9eb5ae6_SeqId_28_ 2023-11-21 13:55:42,345 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__ns_testMinorCompaction__7fip77clolbakb20vp6c08c4gnlo7mdn5iolpaip5eteepe1u024r38i1drsc7o4/family1/35da0bc9c08d42369587e0a0ade7d468 into e72e2258c53c48d805ce683abe6d24d2/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/85213fce9f854b8db9c825ddc9eb5ae6_SeqId_28_ - updating store file list. 2023-11-21 13:55:42,349 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/85213fce9f854b8db9c825ddc9eb5ae6_SeqId_28_ into e72e2258c53c48d805ce683abe6d24d2/family1 2023-11-21 13:55:42,349 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__ns_testMinorCompaction__7fip77clolbakb20vp6c08c4gnlo7mdn5iolpaip5eteepe1u024r38i1drsc7o4/family1/35da0bc9c08d42369587e0a0ade7d468 into e72e2258c53c48d805ce683abe6d24d2/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/family1/85213fce9f854b8db9c825ddc9eb5ae6_SeqId_28_) 2023-11-21 13:55:42,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__ns_testMinorCompaction__7fip77clolbakb20vp6c08c4gnlo7mdn5iolpaip5eteepe1u024r38i1drsc7o4/family1/35da0bc9c08d42369587e0a0ade7d468 2023-11-21 13:55:42,351 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231121 table='ns:testMinorCompaction' column='family1' 2023-11-21 13:55:42,352 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:42,354 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231121451e685336534db5a6127fe48f3c7633 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231121451e685336534db5a6127fe48f3c7633 2023-11-21 13:55:42,354 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-21 13:55:42,354 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231121' 2023-11-21 13:55:42,354 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231121 for table='ns:testMinorCompaction' and column='family1' 2023-11-21 13:55:42,688 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311219f276f7084494455a4b2633d745fd2af to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311219f276f7084494455a4b2633d745fd2af 2023-11-21 13:55:42,689 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231121 table='ns:testMinorCompaction' column='family1' 2023-11-21 13:55:42,692 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231121963ed916bec04a3daefe13339607dc29 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231121963ed916bec04a3daefe13339607dc29 2023-11-21 13:55:42,692 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231121 table='ns:testMinorCompaction' column='family1' 2023-11-21 13:55:42,714 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231121/family1/801943eaddc443a8b9d3a80e3b421e1d first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-21 13:55:42,716 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231121/family1/801943eaddc443a8b9d3a80e3b421e1d}] 2023-11-21 13:55:42,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231121/family1/801943eaddc443a8b9d3a80e3b421e1d for inclusion in 25535f294975fa5548703e68e64b1bfc/family1 2023-11-21 13:55:42,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-21 13:55:42,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last=1 2023-11-21 13:55:42,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 25535f294975fa5548703e68e64b1bfc: 2023-11-21 13:55:42,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231121/family1/801943eaddc443a8b9d3a80e3b421e1d to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__ns_testMinorCompaction__o31491fe43r7op771ptn60oqcc2635hppqdm7ng22tg0fhf1399krjsdjubocuet/family1/801943eaddc443a8b9d3a80e3b421e1d 2023-11-21 13:55:42,723 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231121/family1/2a082396d6364047881faf1172cfdf28 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-21 13:55:42,724 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231121/family1/2a082396d6364047881faf1172cfdf28}] 2023-11-21 13:55:42,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__ns_testMinorCompaction__o31491fe43r7op771ptn60oqcc2635hppqdm7ng22tg0fhf1399krjsdjubocuet/family1/801943eaddc443a8b9d3a80e3b421e1d as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/242f6fb45be24774a1f885fe407e9011_SeqId_28_ 2023-11-21 13:55:42,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__ns_testMinorCompaction__o31491fe43r7op771ptn60oqcc2635hppqdm7ng22tg0fhf1399krjsdjubocuet/family1/801943eaddc443a8b9d3a80e3b421e1d into 25535f294975fa5548703e68e64b1bfc/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/242f6fb45be24774a1f885fe407e9011_SeqId_28_ - updating store file list. 2023-11-21 13:55:42,726 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231121/family1/2a082396d6364047881faf1172cfdf28 for inclusion in 5cb093399d723625f3078fe0d10bdf3b/family1 2023-11-21 13:55:42,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-21 13:55:42,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-21 13:55:42,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 5cb093399d723625f3078fe0d10bdf3b: 2023-11-21 13:55:42,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231121/family1/2a082396d6364047881faf1172cfdf28 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__ns_testMinorCompaction__r0u393c4i4i8nomotn4bpj23j8325iev56fjm7rqq9ikamkg4k33nagvdllug028/family1/2a082396d6364047881faf1172cfdf28 2023-11-21 13:55:42,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/242f6fb45be24774a1f885fe407e9011_SeqId_28_ into 25535f294975fa5548703e68e64b1bfc/family1 2023-11-21 13:55:42,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__ns_testMinorCompaction__o31491fe43r7op771ptn60oqcc2635hppqdm7ng22tg0fhf1399krjsdjubocuet/family1/801943eaddc443a8b9d3a80e3b421e1d into 25535f294975fa5548703e68e64b1bfc/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/family1/242f6fb45be24774a1f885fe407e9011_SeqId_28_) 2023-11-21 13:55:42,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__ns_testMinorCompaction__o31491fe43r7op771ptn60oqcc2635hppqdm7ng22tg0fhf1399krjsdjubocuet/family1/801943eaddc443a8b9d3a80e3b421e1d 2023-11-21 13:55:42,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__ns_testMinorCompaction__r0u393c4i4i8nomotn4bpj23j8325iev56fjm7rqq9ikamkg4k33nagvdllug028/family1/2a082396d6364047881faf1172cfdf28 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/9c6b6563b5c8441592f006015796c2c6_SeqId_28_ 2023-11-21 13:55:42,732 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__ns_testMinorCompaction__r0u393c4i4i8nomotn4bpj23j8325iev56fjm7rqq9ikamkg4k33nagvdllug028/family1/2a082396d6364047881faf1172cfdf28 into 5cb093399d723625f3078fe0d10bdf3b/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/9c6b6563b5c8441592f006015796c2c6_SeqId_28_ - updating store file list. 2023-11-21 13:55:42,732 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231121 table='ns:testMinorCompaction' column='family1' 2023-11-21 13:55:42,733 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:42,734 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112196efe6c231944782b8833f5a19a7bd23 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112196efe6c231944782b8833f5a19a7bd23 2023-11-21 13:55:42,734 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-21 13:55:42,734 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231121' 2023-11-21 13:55:42,735 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231121 for table='ns:testMinorCompaction' and column='family1' 2023-11-21 13:55:42,735 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/9c6b6563b5c8441592f006015796c2c6_SeqId_28_ into 5cb093399d723625f3078fe0d10bdf3b/family1 2023-11-21 13:55:42,736 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__ns_testMinorCompaction__r0u393c4i4i8nomotn4bpj23j8325iev56fjm7rqq9ikamkg4k33nagvdllug028/family1/2a082396d6364047881faf1172cfdf28 into 5cb093399d723625f3078fe0d10bdf3b/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/family1/9c6b6563b5c8441592f006015796c2c6_SeqId_28_) 2023-11-21 13:55:42,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__ns_testMinorCompaction__r0u393c4i4i8nomotn4bpj23j8325iev56fjm7rqq9ikamkg4k33nagvdllug028/family1/2a082396d6364047881faf1172cfdf28 2023-11-21 13:55:42,738 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231121 table='ns:testMinorCompaction' column='family1' 2023-11-21 13:55:42,738 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:42,739 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231121595e24ed3b2248579526d864b037faf0 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231121595e24ed3b2248579526d864b037faf0 2023-11-21 13:55:42,739 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-21 13:55:42,739 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231121' 2023-11-21 13:55:42,740 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231121 for table='ns:testMinorCompaction' and column='family1' 2023-11-21 13:55:42,740 INFO [Listener at localhost/35077] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-21 13:55:42,742 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:55:42,744 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:55:42,747 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:55:42,748 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:55:42,766 INFO [Listener at localhost/35077] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=251 (was 286), OpenFileDescriptor=657 (was 786), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=158 (was 174), ProcessCount=168 (was 168), AvailableMemoryMB=7337 (was 7228) - AvailableMemoryMB LEAK? - 2023-11-21 13:55:42,778 INFO [Listener at localhost/35077] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=251, OpenFileDescriptor=657, MaxFileDescriptor=60000, SystemLoadAverage=158, ProcessCount=168, AvailableMemoryMB=7337 2023-11-21 13:55:42,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-21 13:55:42,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:42,782 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-21 13:55:42,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-21 13:55:42,782 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-21 13:55:42,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-21 13:55:42,784 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a 2023-11-21 13:55:42,784 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a empty. 2023-11-21 13:55:42,784 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a 2023-11-21 13:55:42,784 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-21 13:55:42,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-21 13:55:43,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-21 13:55:43,191 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-21 13:55:43,192 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0eca6e73d2bd4b412cf03f0c2b29562a, NAME => 'testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:55:43,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-21 13:55:43,597 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:43,597 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 0eca6e73d2bd4b412cf03f0c2b29562a, disabling compactions & flushes 2023-11-21 13:55:43,597 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:43,598 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:43,598 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. after waiting 0 ms 2023-11-21 13:55:43,598 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:43,598 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:43,598 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 0eca6e73d2bd4b412cf03f0c2b29562a: 2023-11-21 13:55:43,600 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-21 13:55:43,600 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700574943600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574943600"}]},"ts":"1700574943600"} 2023-11-21 13:55:43,602 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-21 13:55:43,602 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-21 13:55:43,602 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574943602"}]},"ts":"1700574943602"} 2023-11-21 13:55:43,603 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-21 13:55:43,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=0eca6e73d2bd4b412cf03f0c2b29562a, ASSIGN}] 2023-11-21 13:55:43,607 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=0eca6e73d2bd4b412cf03f0c2b29562a, ASSIGN 2023-11-21 13:55:43,608 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=0eca6e73d2bd4b412cf03f0c2b29562a, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:55:43,759 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=0eca6e73d2bd4b412cf03f0c2b29562a, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:43,759 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700574943759"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574943759"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574943759"}]},"ts":"1700574943759"} 2023-11-21 13:55:43,761 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 0eca6e73d2bd4b412cf03f0c2b29562a, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:43,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-21 13:55:43,912 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:43,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:43,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0eca6e73d2bd4b412cf03f0c2b29562a, NAME => 'testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a.', STARTKEY => '', ENDKEY => ''} 2023-11-21 13:55:43,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 0eca6e73d2bd4b412cf03f0c2b29562a 2023-11-21 13:55:43,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:43,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 0eca6e73d2bd4b412cf03f0c2b29562a 2023-11-21 13:55:43,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 0eca6e73d2bd4b412cf03f0c2b29562a 2023-11-21 13:55:43,917 INFO [StoreOpener-0eca6e73d2bd4b412cf03f0c2b29562a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0eca6e73d2bd4b412cf03f0c2b29562a 2023-11-21 13:55:43,919 DEBUG [StoreOpener-0eca6e73d2bd4b412cf03f0c2b29562a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1 2023-11-21 13:55:43,919 DEBUG [StoreOpener-0eca6e73d2bd4b412cf03f0c2b29562a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1 2023-11-21 13:55:43,919 INFO [StoreOpener-0eca6e73d2bd4b412cf03f0c2b29562a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0eca6e73d2bd4b412cf03f0c2b29562a columnFamilyName family1 2023-11-21 13:55:43,920 INFO [StoreOpener-0eca6e73d2bd4b412cf03f0c2b29562a-1] regionserver.HStore(310): Store=0eca6e73d2bd4b412cf03f0c2b29562a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:43,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a 2023-11-21 13:55:43,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a 2023-11-21 13:55:43,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 0eca6e73d2bd4b412cf03f0c2b29562a 2023-11-21 13:55:43,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:55:43,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 0eca6e73d2bd4b412cf03f0c2b29562a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68885816, jitterRate=0.02647864818572998}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-21 13:55:43,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 0eca6e73d2bd4b412cf03f0c2b29562a: 2023-11-21 13:55:43,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a., pid=114, masterSystemTime=1700574943912 2023-11-21 13:55:43,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:43,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:43,927 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=0eca6e73d2bd4b412cf03f0c2b29562a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:43,927 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700574943927"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574943927"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574943927"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574943927"}]},"ts":"1700574943927"} 2023-11-21 13:55:43,929 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=114, resume processing ppid=113 2023-11-21 13:55:43,929 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 0eca6e73d2bd4b412cf03f0c2b29562a, server=jenkins-hbase6.apache.org,46365,1700574804408 in 167 msec 2023-11-21 13:55:43,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=113, resume processing ppid=112 2023-11-21 13:55:43,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=0eca6e73d2bd4b412cf03f0c2b29562a, ASSIGN in 323 msec 2023-11-21 13:55:43,931 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-21 13:55:43,931 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574943931"}]},"ts":"1700574943931"} 2023-11-21 13:55:43,932 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-21 13:55:43,937 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-21 13:55:43,938 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1570 sec 2023-11-21 13:55:44,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-21 13:55:44,887 INFO [Listener at localhost/35077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-21 13:55:44,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:44,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:44,909 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:44,909 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:44,909 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:55:44,909 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:55:44,910 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:44,910 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:44,911 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:44,911 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:44,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:44,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:44,911 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:44,912 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:44,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:44,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:44,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:44,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:44,912 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:44,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:44,913 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:55:44,913 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:44,913 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:55:44,913 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:55:44,913 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:44,913 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:44,913 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. started... 2023-11-21 13:55:44,914 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0eca6e73d2bd4b412cf03f0c2b29562a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-21 13:55:45,332 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130df5957b73cf94df0b5672296a934ec5b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130df5957b73cf94df0b5672296a934ec5b 2023-11-21 13:55:45,735 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/23e4e623d94e40e5bc4b8bd1a65fcf86 2023-11-21 13:55:45,739 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/23e4e623d94e40e5bc4b8bd1a65fcf86 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/23e4e623d94e40e5bc4b8bd1a65fcf86 2023-11-21 13:55:45,741 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/23e4e623d94e40e5bc4b8bd1a65fcf86, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-21 13:55:45,742 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 0eca6e73d2bd4b412cf03f0c2b29562a in 828ms, sequenceid=5, compaction requested=false 2023-11-21 13:55:45,742 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:45,743 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0eca6e73d2bd4b412cf03f0c2b29562a: 2023-11-21 13:55:45,743 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:45,743 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:55:45,743 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:55:45,743 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:45,743 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:55:45,743 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:55:45,748 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:45,748 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:45,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:45,749 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,749 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:45,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:55:45,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c8dba22[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:45,750 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:55:45,750 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,751 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,752 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:55:45,752 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:55:45,752 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:45,752 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:45,752 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:45,753 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:55:45,753 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:45,753 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:45,753 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:55:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:45,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:45,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:45,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:45,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:45,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:45,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:55:45,755 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:55:45,756 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:45,756 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:45,756 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,756 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:45,762 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,762 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:45,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:45,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,762 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:45,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:45,763 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:45,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:45,764 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:45,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:45,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:45,766 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:45,766 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,766 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:45,766 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:45,766 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:45,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:45,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:45,766 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:45,766 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:45,767 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:45,767 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,767 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,767 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:45,767 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:45,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:45,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:45,867 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:45,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:45,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:45,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:45,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,875 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:45,875 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:45,875 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:55:45,875 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:55:45,875 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,875 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,876 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:45,876 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:45,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:45,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:45,877 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:45,877 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:45,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:45,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,878 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,878 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-21 13:55:45,878 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:45,878 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:55:45,878 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:45,878 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:55:45,878 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:55:45,878 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:45,878 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:45,878 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. started... 2023-11-21 13:55:45,878 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0eca6e73d2bd4b412cf03f0c2b29562a 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-21 13:55:46,291 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128fb06cb6108f643b7bd1af96380d3c0bd to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128fb06cb6108f643b7bd1af96380d3c0bd 2023-11-21 13:55:46,696 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/3c8f810a19984b4ab329d5dc54e6ba79 2023-11-21 13:55:46,699 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/3c8f810a19984b4ab329d5dc54e6ba79 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/3c8f810a19984b4ab329d5dc54e6ba79 2023-11-21 13:55:46,702 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/3c8f810a19984b4ab329d5dc54e6ba79, entries=1, sequenceid=9, filesize=5.0 K 2023-11-21 13:55:46,703 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 0eca6e73d2bd4b412cf03f0c2b29562a in 825ms, sequenceid=9, compaction requested=false 2023-11-21 13:55:46,703 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0eca6e73d2bd4b412cf03f0c2b29562a: 2023-11-21 13:55:46,703 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:46,703 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:55:46,703 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:55:46,703 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:46,703 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:55:46,703 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:55:46,705 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:46,705 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:46,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:46,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:46,705 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,705 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:46,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:46,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:46,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:46,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:46,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:55:46,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e432691[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:46,707 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:55:46,707 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,709 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,709 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:55:46,709 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:55:46,709 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:46,709 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:46,709 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:46,710 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:55:46,710 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:46,710 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:46,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:46,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:46,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:46,710 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:55:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:46,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:46,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:46,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:46,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:55:46,713 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:55:46,713 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:46,713 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:46,713 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,713 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:46,714 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,714 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:46,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:46,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,714 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:46,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:46,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:46,715 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:46,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:46,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:46,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:46,716 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:46,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:46,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:46,718 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:46,718 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,718 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:46,718 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,718 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:46,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:46,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:46,718 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:46,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-21 13:55:46,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:46,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:46,718 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:46,719 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,719 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:46,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:46,719 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,719 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:46,719 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:46,819 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:46,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:46,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:46,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:46,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,825 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:46,825 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:46,825 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:55:46,825 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:55:46,825 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,825 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,828 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:46,828 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:46,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:46,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:46,828 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:46,828 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:46,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,829 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:46,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,829 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,829 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-21 13:55:46,829 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:46,830 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:55:46,830 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:46,830 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:55:46,830 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:55:46,830 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:46,830 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:46,830 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. started... 2023-11-21 13:55:46,830 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0eca6e73d2bd4b412cf03f0c2b29562a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:55:47,245 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120111e43acefc354b6bbba02f6c58e75f1e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120111e43acefc354b6bbba02f6c58e75f1e 2023-11-21 13:55:47,650 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/7479b1a7249b4a4eb892d1810785d935 2023-11-21 13:55:47,654 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/7479b1a7249b4a4eb892d1810785d935 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/7479b1a7249b4a4eb892d1810785d935 2023-11-21 13:55:47,658 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/7479b1a7249b4a4eb892d1810785d935, entries=1, sequenceid=13, filesize=4.9 K 2023-11-21 13:55:47,658 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0eca6e73d2bd4b412cf03f0c2b29562a in 828ms, sequenceid=13, compaction requested=true 2023-11-21 13:55:47,659 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0eca6e73d2bd4b412cf03f0c2b29562a: 2023-11-21 13:55:47,659 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:47,659 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:55:47,659 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:55:47,659 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:47,659 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:55:47,659 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:55:47,660 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:47,660 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:47,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:47,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:47,661 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,661 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:47,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:47,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:47,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:47,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:47,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:55:47,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bd848ac[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:47,662 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:55:47,662 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,663 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,664 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:55:47,664 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:55:47,664 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:47,664 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:47,664 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:47,665 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:55:47,665 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:47,665 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:47,665 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:55:47,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:47,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:47,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:47,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:47,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:47,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:47,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:47,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:47,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:47,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:55:47,667 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:55:47,667 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:47,667 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:47,667 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,667 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:47,670 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,670 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:47,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:47,670 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:47,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:47,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:47,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:47,670 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:47,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:47,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,671 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:47,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:47,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:47,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:47,676 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:47,676 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:47,676 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:47,676 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:47,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-21 13:55:47,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:47,676 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:47,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:47,676 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:47,677 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:47,677 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,677 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,677 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,677 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:47,677 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:47,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:47,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:47,777 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:47,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:47,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:47,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:47,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,783 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:47,783 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:47,783 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:55:47,783 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:55:47,783 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,783 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,785 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:47,785 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:47,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:47,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:47,785 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:47,785 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:47,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:47,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,786 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,786 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-21 13:55:47,786 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:47,786 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:55:47,786 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:47,786 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:55:47,786 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:55:47,786 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:47,786 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:47,786 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. started... 2023-11-21 13:55:47,786 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0eca6e73d2bd4b412cf03f0c2b29562a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:55:48,197 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205686004df2027451ab41114148bb953c2 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205686004df2027451ab41114148bb953c2 2023-11-21 13:55:48,603 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/eff2228505e441bfb77c8163883fec8a 2023-11-21 13:55:48,607 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/eff2228505e441bfb77c8163883fec8a as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/eff2228505e441bfb77c8163883fec8a 2023-11-21 13:55:48,611 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/eff2228505e441bfb77c8163883fec8a, entries=1, sequenceid=17, filesize=4.9 K 2023-11-21 13:55:48,612 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0eca6e73d2bd4b412cf03f0c2b29562a in 826ms, sequenceid=17, compaction requested=true 2023-11-21 13:55:48,612 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0eca6e73d2bd4b412cf03f0c2b29562a: 2023-11-21 13:55:48,612 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:48,612 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:55:48,612 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:55:48,612 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:48,612 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:55:48,612 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:55:48,614 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,614 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:48,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:48,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:48,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:48,614 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,614 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:48,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:48,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:48,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:48,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:48,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:55:48,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27570760[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:48,616 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:55:48,616 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,617 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,617 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:55:48,617 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:55:48,617 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:48,617 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:48,617 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:48,618 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:55:48,618 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:48,618 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:48,618 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:55:48,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:48,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:48,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:48,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:48,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:48,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:48,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:48,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:48,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:48,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:55:48,621 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:55:48,621 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:48,621 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:48,621 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,621 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:48,623 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,623 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,623 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:48,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:48,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:48,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:48,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:48,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:48,624 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:48,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:48,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:48,625 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:48,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:48,629 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:48,629 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:48,629 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:48,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-21 13:55:48,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:48,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:48,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:48,629 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:48,629 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,629 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:48,629 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:48,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:48,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:48,629 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,629 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:48,630 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:48,629 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,630 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,730 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:48,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:48,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:48,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:48,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,736 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:48,736 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:48,736 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:55:48,736 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:55:48,737 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,737 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,738 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:48,738 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:48,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:48,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:48,738 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:48,738 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:48,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:48,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,739 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,740 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-21 13:55:48,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:48,740 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:55:48,740 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:48,740 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:55:48,743 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:55:48,743 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:48,743 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:48,744 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. started... 2023-11-21 13:55:48,744 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0eca6e73d2bd4b412cf03f0c2b29562a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:55:49,159 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228ac12d2cd541646cf8792305d79376dd1 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228ac12d2cd541646cf8792305d79376dd1 2023-11-21 13:55:49,454 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-21 13:55:49,564 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/cfebcce0af974294a4798c7dfadfb410 2023-11-21 13:55:49,568 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/cfebcce0af974294a4798c7dfadfb410 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/cfebcce0af974294a4798c7dfadfb410 2023-11-21 13:55:49,572 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/cfebcce0af974294a4798c7dfadfb410, entries=1, sequenceid=21, filesize=4.9 K 2023-11-21 13:55:49,573 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0eca6e73d2bd4b412cf03f0c2b29562a in 829ms, sequenceid=21, compaction requested=true 2023-11-21 13:55:49,573 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0eca6e73d2bd4b412cf03f0c2b29562a: 2023-11-21 13:55:49,573 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:49,573 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:55:49,573 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:55:49,573 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:49,573 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:55:49,573 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:55:49,575 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:49,575 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:49,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:49,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:49,575 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,576 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:49,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:49,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:49,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:49,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:49,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:55:49,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@765af502[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:49,577 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:55:49,577 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,580 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,580 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:55:49,580 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:55:49,580 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:49,580 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:49,580 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:49,581 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:55:49,581 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:49,582 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:49,582 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:55:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:49,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:49,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:49,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:49,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:49,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:55:49,584 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:55:49,584 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:49,584 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:49,584 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,584 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:49,586 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,586 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,586 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:49,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:49,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:49,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:49,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:49,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:49,587 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:49,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:49,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:49,588 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:49,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:49,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:49,590 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:49,590 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,590 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,590 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:49,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-21 13:55:49,590 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:49,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:49,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:49,590 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:49,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:49,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:49,591 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:49,591 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,591 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,591 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,591 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:49,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:49,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:49,591 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:49,691 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:49,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:49,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:49,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:49,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,698 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:49,698 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:49,698 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:55:49,698 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:55:49,698 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,698 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,701 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:49,701 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:49,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:49,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:49,701 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:49,701 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:49,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,701 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:49,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,702 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,702 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-21 13:55:49,702 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:49,702 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:55:49,702 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:49,702 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:55:49,702 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:55:49,702 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:49,702 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:49,702 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. started... 2023-11-21 13:55:49,703 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0eca6e73d2bd4b412cf03f0c2b29562a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:55:50,113 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123133ed0726f02d4bd2bff7f93ad65e25c5 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123133ed0726f02d4bd2bff7f93ad65e25c5 2023-11-21 13:55:50,118 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/2bff00ea1ab048b1a8c322d9814358d9 2023-11-21 13:55:50,121 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/2bff00ea1ab048b1a8c322d9814358d9 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/2bff00ea1ab048b1a8c322d9814358d9 2023-11-21 13:55:50,124 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/2bff00ea1ab048b1a8c322d9814358d9, entries=1, sequenceid=25, filesize=4.9 K 2023-11-21 13:55:50,125 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0eca6e73d2bd4b412cf03f0c2b29562a in 422ms, sequenceid=25, compaction requested=true 2023-11-21 13:55:50,125 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0eca6e73d2bd4b412cf03f0c2b29562a: 2023-11-21 13:55:50,125 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:50,125 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:55:50,125 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:55:50,125 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,125 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:55:50,125 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:55:50,127 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,127 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:50,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:50,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:50,127 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,127 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:50,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:50,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:50,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:55:50,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@114a22f6[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:50,129 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:55:50,129 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,130 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,130 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:55:50,130 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:55:50,130 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:50,130 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,130 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:50,136 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:55:50,136 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,136 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:50,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:50,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:50,136 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:55:50,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:50,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:50,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:50,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:50,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:55:50,139 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:55:50,139 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:50,139 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:50,139 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,139 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:50,140 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,140 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:50,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:50,140 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:50,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:50,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:50,141 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:50,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,142 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:50,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,144 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,144 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,144 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,144 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:50,144 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-21 13:55:50,144 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:50,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:50,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:50,144 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,144 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:50,145 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:50,145 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,145 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:50,145 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:50,145 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:50,245 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:50,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:50,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:50,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:50,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,251 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:50,251 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:50,251 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:55:50,251 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:55:50,251 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,251 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,252 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:50,252 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:50,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:50,253 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,253 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:50,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:50,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,253 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,254 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-21 13:55:50,254 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,254 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:55:50,254 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:50,254 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:55:50,254 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:55:50,254 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:50,254 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:50,254 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. started... 2023-11-21 13:55:50,254 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0eca6e73d2bd4b412cf03f0c2b29562a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:55:50,665 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101b6238ce8cefd47b19bdcee7bdba18d80 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101b6238ce8cefd47b19bdcee7bdba18d80 2023-11-21 13:55:50,669 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/7515d8c578cd436fb3a3b3e17a799bbf 2023-11-21 13:55:50,673 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/7515d8c578cd436fb3a3b3e17a799bbf as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/7515d8c578cd436fb3a3b3e17a799bbf 2023-11-21 13:55:50,676 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/7515d8c578cd436fb3a3b3e17a799bbf, entries=1, sequenceid=29, filesize=4.9 K 2023-11-21 13:55:50,676 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0eca6e73d2bd4b412cf03f0c2b29562a in 422ms, sequenceid=29, compaction requested=true 2023-11-21 13:55:50,677 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0eca6e73d2bd4b412cf03f0c2b29562a: 2023-11-21 13:55:50,677 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:50,677 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:55:50,677 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:55:50,677 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,677 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:55:50,677 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:55:50,679 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:50,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:50,679 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:50,679 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,679 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:50,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:50,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:50,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:55:50,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@84e955b[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:50,681 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:55:50,681 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,682 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,682 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:55:50,682 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:55:50,682 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:50,682 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,682 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:50,684 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:55:50,684 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,684 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:50,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:50,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:50,684 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:55:50,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:50,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:50,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:50,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:50,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:55:50,686 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:55:50,686 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:50,686 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:50,686 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,686 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:50,688 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,688 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:50,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:50,688 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:50,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:50,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:50,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:50,688 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:50,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,690 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:50,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,693 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,694 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:50,694 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:50,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:50,694 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,694 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:50,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:50,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:50,694 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:50,694 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:50,694 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:50,694 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,694 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,694 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:50,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:50,694 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,794 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:50,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:50,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:50,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:50,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,800 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:50,800 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:50,800 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:55:50,800 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:55:50,800 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,800 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,802 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,802 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:50,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:50,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:50,802 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:50,802 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:50,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,803 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,803 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,803 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-21 13:55:50,803 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:50,803 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:55:50,803 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:50,803 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:55:50,803 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:55:50,803 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:50,803 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:50,803 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. started... 2023-11-21 13:55:50,804 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0eca6e73d2bd4b412cf03f0c2b29562a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:55:51,214 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d00cd16ddb4f4acd9261f1fd09520229 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103d00cd16ddb4f4acd9261f1fd09520229 2023-11-21 13:55:51,619 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/622e88c0876c445882bf648425756903 2023-11-21 13:55:51,625 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/622e88c0876c445882bf648425756903 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/622e88c0876c445882bf648425756903 2023-11-21 13:55:51,628 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/622e88c0876c445882bf648425756903, entries=1, sequenceid=33, filesize=4.9 K 2023-11-21 13:55:51,629 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0eca6e73d2bd4b412cf03f0c2b29562a in 825ms, sequenceid=33, compaction requested=true 2023-11-21 13:55:51,629 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0eca6e73d2bd4b412cf03f0c2b29562a: 2023-11-21 13:55:51,629 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:51,629 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:55:51,630 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:55:51,630 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:51,630 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:55:51,630 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:55:51,632 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:51,632 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:51,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:51,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:51,632 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,632 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:51,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:51,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:51,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:51,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:51,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:55:51,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17bdef35[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:51,634 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:55:51,634 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,635 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,635 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:55:51,635 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:55:51,635 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:51,635 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:51,635 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:51,637 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:55:51,637 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:51,637 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:51,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:51,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:51,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:51,637 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:55:51,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:51,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:51,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:51,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:51,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:51,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:51,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:55:51,640 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:55:51,640 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:51,640 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:51,640 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,640 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:51,641 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,641 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,641 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:51,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,642 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:51,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,643 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:51,645 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:51,645 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:51,645 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:51,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-21 13:55:51,645 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:51,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:51,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:51,645 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,646 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:51,646 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,646 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,646 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,646 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:51,646 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:51,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:51,646 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:51,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:51,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:51,746 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:51,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:51,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:51,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:51,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,752 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:51,752 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:51,752 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:55:51,752 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:55:51,753 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,753 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,754 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:51,754 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:51,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:51,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:51,754 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:51,754 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:51,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,755 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:51,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,755 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,755 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-21 13:55:51,755 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:51,755 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:55:51,755 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:51,755 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:55:51,755 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:55:51,755 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:51,756 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:51,756 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. started... 2023-11-21 13:55:51,756 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0eca6e73d2bd4b412cf03f0c2b29562a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:55:52,166 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074889e1b5e8e448f588dd53580acce177 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509074889e1b5e8e448f588dd53580acce177 2023-11-21 13:55:52,571 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/48d8977c11b74de281dc35e155023503 2023-11-21 13:55:52,574 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/48d8977c11b74de281dc35e155023503 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/48d8977c11b74de281dc35e155023503 2023-11-21 13:55:52,577 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/48d8977c11b74de281dc35e155023503, entries=1, sequenceid=37, filesize=4.9 K 2023-11-21 13:55:52,578 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0eca6e73d2bd4b412cf03f0c2b29562a in 822ms, sequenceid=37, compaction requested=true 2023-11-21 13:55:52,578 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0eca6e73d2bd4b412cf03f0c2b29562a: 2023-11-21 13:55:52,578 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:52,578 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:55:52,578 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:55:52,578 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:52,579 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:55:52,579 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:55:52,584 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:52,584 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:52,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:52,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:52,584 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,584 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:52,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:52,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:52,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:52,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:52,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:55:52,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36eefa25[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:52,586 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:55:52,586 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,587 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,587 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:55:52,587 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:55:52,587 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:52,587 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:52,587 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:52,588 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:55:52,588 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:52,588 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:52,588 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:55:52,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:52,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:52,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:52,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:52,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:52,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:52,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:52,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:52,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:52,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:55:52,591 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:55:52,591 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:52,591 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:52,591 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,591 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:52,593 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,593 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:52,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:52,593 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:52,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,593 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:52,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:52,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:52,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:52,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:52,594 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:52,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:52,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:52,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:52,598 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:52,598 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,598 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,598 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:52,598 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:52,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:52,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:52,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:52,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:52,598 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:52,598 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-21 13:55:52,598 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,598 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:52,598 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:52,598 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,599 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:52,599 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:52,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:52,699 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:52,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:52,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:52,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:52,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,705 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:52,705 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:52,705 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-21 13:55:52,705 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-21 13:55:52,705 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,705 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,706 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:52,706 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:52,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:52,707 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:52,707 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,707 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,708 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-21 13:55:52,708 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:52,708 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-21 13:55:52,708 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:52,708 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-21 13:55:52,708 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-21 13:55:52,708 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:52,708 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:52,708 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. started... 2023-11-21 13:55:52,708 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0eca6e73d2bd4b412cf03f0c2b29562a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-21 13:55:53,119 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511203d439061d9b349c4bd3c77b64bc65d13 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511203d439061d9b349c4bd3c77b64bc65d13 2023-11-21 13:55:53,523 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/18384b4b6e404fd2862f60ddee16b77f 2023-11-21 13:55:53,527 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/18384b4b6e404fd2862f60ddee16b77f as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/18384b4b6e404fd2862f60ddee16b77f 2023-11-21 13:55:53,531 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/18384b4b6e404fd2862f60ddee16b77f, entries=1, sequenceid=41, filesize=4.9 K 2023-11-21 13:55:53,531 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0eca6e73d2bd4b412cf03f0c2b29562a in 823ms, sequenceid=41, compaction requested=true 2023-11-21 13:55:53,531 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0eca6e73d2bd4b412cf03f0c2b29562a: 2023-11-21 13:55:53,531 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:53,531 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-21 13:55:53,532 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-21 13:55:53,532 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:53,532 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-21 13:55:53,532 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-21 13:55:53,533 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:53,533 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:53,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:53,534 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,534 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:53,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:53,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:53,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:53,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:53,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-21 13:55:53,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76f3239c[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:53,535 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-21 13:55:53,535 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,542 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,543 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-21 13:55:53,543 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-21 13:55:53,543 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:53,543 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:53,543 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:53,544 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-21 13:55:53,544 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:53,544 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:53,544 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-21 13:55:53,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:53,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:53,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:53,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:53,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:53,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:53,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:53,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:53,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:53,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-21 13:55:53,546 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-21 13:55:53,547 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:53,547 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:53,547 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,547 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:53,548 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,548 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:53,548 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:53,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:53,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:53,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:53,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:53,549 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:53,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:53,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,550 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:53,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:53,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:53,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:53,552 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:53,552 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,552 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:53,552 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:53,552 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:53,552 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:53,552 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:53,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-21 13:55:53,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:53,552 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:53,553 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,553 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,553 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:53,553 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:53,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-21 13:55:53,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:53,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:53,653 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:53,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:53,655 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43219] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-21 13:55:53,656 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-21 13:55:53,657 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-21 13:55:53,658 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:55:53,658 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700575553658 2023-11-21 13:55:53,658 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-21 13:55:53,659 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-21 13:55:53,659 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-21 13:55:53,660 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] zookeeper.ReadOnlyZKClient(139): Connect 0x6a079aaa to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:55:53,665 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57c453b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:55:53,666 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-21 13:55:54,090 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032ca622fa6e504ea7b80655c011102394 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601032ca622fa6e504ea7b80655c011102394 2023-11-21 13:55:54,091 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-21 13:55:54,103 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:55:54,105 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:47174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:55:54,110 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-21 13:55:54,111 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:33008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-21 13:55:54,118 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f67c90120f3c4f09bbe538c206034469 first=Optional[r5] last=Optional[r6] 2023-11-21 13:55:54,118 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f67c90120f3c4f09bbe538c206034469}] 2023-11-21 13:55:54,129 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f67c90120f3c4f09bbe538c206034469 for inclusion in 0eca6e73d2bd4b412cf03f0c2b29562a/family1 2023-11-21 13:55:54,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-21 13:55:54,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:55:54,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 0eca6e73d2bd4b412cf03f0c2b29562a: 2023-11-21 13:55:54,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f67c90120f3c4f09bbe538c206034469 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__unepr330joip22ehncbeb4q99g02294en39tbt1v105r1id761p84ridlktl6b3l/family1/f67c90120f3c4f09bbe538c206034469 2023-11-21 13:55:54,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__unepr330joip22ehncbeb4q99g02294en39tbt1v105r1id761p84ridlktl6b3l/family1/f67c90120f3c4f09bbe538c206034469 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/b45db37ac5314450b6fdf6697f6523cd_SeqId_44_ 2023-11-21 13:55:54,135 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__unepr330joip22ehncbeb4q99g02294en39tbt1v105r1id761p84ridlktl6b3l/family1/f67c90120f3c4f09bbe538c206034469 into 0eca6e73d2bd4b412cf03f0c2b29562a/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/b45db37ac5314450b6fdf6697f6523cd_SeqId_44_ - updating store file list. 2023-11-21 13:55:54,137 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/b45db37ac5314450b6fdf6697f6523cd_SeqId_44_ into 0eca6e73d2bd4b412cf03f0c2b29562a/family1 2023-11-21 13:55:54,137 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__unepr330joip22ehncbeb4q99g02294en39tbt1v105r1id761p84ridlktl6b3l/family1/f67c90120f3c4f09bbe538c206034469 into 0eca6e73d2bd4b412cf03f0c2b29562a/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/b45db37ac5314450b6fdf6697f6523cd_SeqId_44_) 2023-11-21 13:55:54,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__unepr330joip22ehncbeb4q99g02294en39tbt1v105r1id761p84ridlktl6b3l/family1/f67c90120f3c4f09bbe538c206034469 2023-11-21 13:55:54,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-21 13:55:54,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-21 13:55:54,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(1912): 0eca6e73d2bd4b412cf03f0c2b29562a/family1 is initiating minor compaction 2023-11-21 13:55:54,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@675fdb8e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:55:54,140 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0eca6e73d2bd4b412cf03f0c2b29562a/family1 in testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:54,141 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/3c8f810a19984b4ab329d5dc54e6ba79, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/7479b1a7249b4a4eb892d1810785d935, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/eff2228505e441bfb77c8163883fec8a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/cfebcce0af974294a4798c7dfadfb410, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/2bff00ea1ab048b1a8c322d9814358d9, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/7515d8c578cd436fb3a3b3e17a799bbf, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/622e88c0876c445882bf648425756903, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/48d8977c11b74de281dc35e155023503, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/18384b4b6e404fd2862f60ddee16b77f, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/b45db37ac5314450b6fdf6697f6523cd_SeqId_44_] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp, totalSize=49.7 K 2023-11-21 13:55:54,141 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 3c8f810a19984b4ab329d5dc54e6ba79, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-21 13:55:54,141 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 7479b1a7249b4a4eb892d1810785d935, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-21 13:55:54,141 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting eff2228505e441bfb77c8163883fec8a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-21 13:55:54,141 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting cfebcce0af974294a4798c7dfadfb410, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-21 13:55:54,141 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 2bff00ea1ab048b1a8c322d9814358d9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-21 13:55:54,141 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 7515d8c578cd436fb3a3b3e17a799bbf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-21 13:55:54,141 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 622e88c0876c445882bf648425756903, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-21 13:55:54,141 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 48d8977c11b74de281dc35e155023503, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-21 13:55:54,141 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 18384b4b6e404fd2862f60ddee16b77f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-21 13:55:54,141 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting b45db37ac5314450b6fdf6697f6523cd_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-21 13:55:54,142 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-21 13:55:54,143 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:54,144 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101b6238ce8cefd47b19bdcee7bdba18d80 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101b6238ce8cefd47b19bdcee7bdba18d80 2023-11-21 13:55:54,145 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103d00cd16ddb4f4acd9261f1fd09520229 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103d00cd16ddb4f4acd9261f1fd09520229 2023-11-21 13:55:54,145 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-21 13:55:54,145 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-21 13:55:54,146 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-21 13:55:54,146 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-21 13:55:54,164 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0eca6e73d2bd4b412cf03f0c2b29562a#family1#compaction#166 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-21 13:55:54,177 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/769d35216db743b9b88424d5fe033faa as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/769d35216db743b9b88424d5fe033faa 2023-11-21 13:55:54,181 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 0eca6e73d2bd4b412cf03f0c2b29562a/family1 of 0eca6e73d2bd4b412cf03f0c2b29562a into 769d35216db743b9b88424d5fe033faa(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:55:54,181 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0eca6e73d2bd4b412cf03f0c2b29562a: 2023-11-21 13:55:54,182 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1700574954140; duration=0sec 2023-11-21 13:55:54,182 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:55:54,219 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/3c8f810a19984b4ab329d5dc54e6ba79, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/7479b1a7249b4a4eb892d1810785d935, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/eff2228505e441bfb77c8163883fec8a, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/cfebcce0af974294a4798c7dfadfb410, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/2bff00ea1ab048b1a8c322d9814358d9, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/7515d8c578cd436fb3a3b3e17a799bbf, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/622e88c0876c445882bf648425756903, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/48d8977c11b74de281dc35e155023503, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/18384b4b6e404fd2862f60ddee16b77f, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/b45db37ac5314450b6fdf6697f6523cd_SeqId_44_] to archive 2023-11-21 13:55:54,220 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:54,221 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/3c8f810a19984b4ab329d5dc54e6ba79 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/3c8f810a19984b4ab329d5dc54e6ba79 2023-11-21 13:55:54,222 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/7479b1a7249b4a4eb892d1810785d935 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/7479b1a7249b4a4eb892d1810785d935 2023-11-21 13:55:54,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/eff2228505e441bfb77c8163883fec8a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/eff2228505e441bfb77c8163883fec8a 2023-11-21 13:55:54,224 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/cfebcce0af974294a4798c7dfadfb410 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/cfebcce0af974294a4798c7dfadfb410 2023-11-21 13:55:54,225 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/2bff00ea1ab048b1a8c322d9814358d9 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/2bff00ea1ab048b1a8c322d9814358d9 2023-11-21 13:55:54,226 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/7515d8c578cd436fb3a3b3e17a799bbf to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/7515d8c578cd436fb3a3b3e17a799bbf 2023-11-21 13:55:54,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/622e88c0876c445882bf648425756903 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/622e88c0876c445882bf648425756903 2023-11-21 13:55:54,228 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/48d8977c11b74de281dc35e155023503 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/48d8977c11b74de281dc35e155023503 2023-11-21 13:55:54,229 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/18384b4b6e404fd2862f60ddee16b77f to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/18384b4b6e404fd2862f60ddee16b77f 2023-11-21 13:55:54,230 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/b45db37ac5314450b6fdf6697f6523cd_SeqId_44_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/b45db37ac5314450b6fdf6697f6523cd_SeqId_44_ 2023-11-21 13:55:54,580 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231929daf71d9da406db04f1608d43578f7 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231929daf71d9da406db04f1608d43578f7 2023-11-21 13:55:54,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-21 13:55:54,610 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/b0542927921d473ca2b91f655fb7ab9e first=Optional[r1] last=Optional[r4] 2023-11-21 13:55:54,611 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/b0542927921d473ca2b91f655fb7ab9e}] 2023-11-21 13:55:54,613 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/b0542927921d473ca2b91f655fb7ab9e for inclusion in 0eca6e73d2bd4b412cf03f0c2b29562a/family1 2023-11-21 13:55:54,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-21 13:55:54,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:55:54,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 0eca6e73d2bd4b412cf03f0c2b29562a: 2023-11-21 13:55:54,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/b0542927921d473ca2b91f655fb7ab9e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__9ogc8rjqq0hvvuirm9atos244v62ppmvul7p26544r5agbbvg0oi3md9q9q8n9hd/family1/b0542927921d473ca2b91f655fb7ab9e 2023-11-21 13:55:54,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__9ogc8rjqq0hvvuirm9atos244v62ppmvul7p26544r5agbbvg0oi3md9q9q8n9hd/family1/b0542927921d473ca2b91f655fb7ab9e as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/87536542688146bab290887bf3fae80f_SeqId_47_ 2023-11-21 13:55:54,619 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__9ogc8rjqq0hvvuirm9atos244v62ppmvul7p26544r5agbbvg0oi3md9q9q8n9hd/family1/b0542927921d473ca2b91f655fb7ab9e into 0eca6e73d2bd4b412cf03f0c2b29562a/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/87536542688146bab290887bf3fae80f_SeqId_47_ - updating store file list. 2023-11-21 13:55:54,622 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/87536542688146bab290887bf3fae80f_SeqId_47_ into 0eca6e73d2bd4b412cf03f0c2b29562a/family1 2023-11-21 13:55:54,622 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__9ogc8rjqq0hvvuirm9atos244v62ppmvul7p26544r5agbbvg0oi3md9q9q8n9hd/family1/b0542927921d473ca2b91f655fb7ab9e into 0eca6e73d2bd4b412cf03f0c2b29562a/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/87536542688146bab290887bf3fae80f_SeqId_47_) 2023-11-21 13:55:54,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__9ogc8rjqq0hvvuirm9atos244v62ppmvul7p26544r5agbbvg0oi3md9q9q8n9hd/family1/b0542927921d473ca2b91f655fb7ab9e 2023-11-21 13:55:54,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-21 13:55:54,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-21 13:55:54,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(1912): 0eca6e73d2bd4b412cf03f0c2b29562a/family1 is initiating minor compaction (all files) 2023-11-21 13:55:54,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@9e4e922; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:55:54,624 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0eca6e73d2bd4b412cf03f0c2b29562a/family1 in testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:55:54,624 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/23e4e623d94e40e5bc4b8bd1a65fcf86, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/769d35216db743b9b88424d5fe033faa, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/87536542688146bab290887bf3fae80f_SeqId_47_] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp, totalSize=178.1 K 2023-11-21 13:55:54,624 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 23e4e623d94e40e5bc4b8bd1a65fcf86, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878827509 2023-11-21 13:55:54,625 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 769d35216db743b9b88424d5fe033faa, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621227509 2023-11-21 13:55:54,625 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] compactions.Compactor(207): Compacting 87536542688146bab290887bf3fae80f_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965227509 2023-11-21 13:55:54,626 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-21 13:55:54,632 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:54,633 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120111e43acefc354b6bbba02f6c58e75f1e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120111e43acefc354b6bbba02f6c58e75f1e 2023-11-21 13:55:54,634 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205686004df2027451ab41114148bb953c2 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205686004df2027451ab41114148bb953c2 2023-11-21 13:55:54,636 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228ac12d2cd541646cf8792305d79376dd1 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228ac12d2cd541646cf8792305d79376dd1 2023-11-21 13:55:54,637 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123133ed0726f02d4bd2bff7f93ad65e25c5 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123133ed0726f02d4bd2bff7f93ad65e25c5 2023-11-21 13:55:54,637 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-21 13:55:54,637 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-21 13:55:54,637 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-21 13:55:54,637 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-21 13:55:54,646 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0eca6e73d2bd4b412cf03f0c2b29562a#family1#compaction#167 average throughput is 22.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-21 13:55:54,677 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130da8f2f891a0848409886b6d2e6639942 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130da8f2f891a0848409886b6d2e6639942 2023-11-21 13:55:54,678 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-21 13:55:54,699 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/667773dea9b843e18bd64e954940569a first=Optional[r00] last=Optional[r8] 2023-11-21 13:55:54,699 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/667773dea9b843e18bd64e954940569a}] 2023-11-21 13:55:54,701 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/667773dea9b843e18bd64e954940569a for inclusion in 0eca6e73d2bd4b412cf03f0c2b29562a/family1 2023-11-21 13:55:54,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-21 13:55:54,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last= 2023-11-21 13:55:54,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 0eca6e73d2bd4b412cf03f0c2b29562a: 2023-11-21 13:55:54,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/667773dea9b843e18bd64e954940569a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__csma8b3mivd3928l4289lt1h64tr6l2f8hp1vhj97ji3ju4b2r0pnlmdddeg1cum/family1/667773dea9b843e18bd64e954940569a 2023-11-21 13:55:54,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__csma8b3mivd3928l4289lt1h64tr6l2f8hp1vhj97ji3ju4b2r0pnlmdddeg1cum/family1/667773dea9b843e18bd64e954940569a as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/039094b090794d708f54298da439f35e_SeqId_49_ 2023-11-21 13:55:54,707 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__csma8b3mivd3928l4289lt1h64tr6l2f8hp1vhj97ji3ju4b2r0pnlmdddeg1cum/family1/667773dea9b843e18bd64e954940569a into 0eca6e73d2bd4b412cf03f0c2b29562a/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/039094b090794d708f54298da439f35e_SeqId_49_ - updating store file list. 2023-11-21 13:55:54,710 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/039094b090794d708f54298da439f35e_SeqId_49_ into 0eca6e73d2bd4b412cf03f0c2b29562a/family1 2023-11-21 13:55:54,710 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__csma8b3mivd3928l4289lt1h64tr6l2f8hp1vhj97ji3ju4b2r0pnlmdddeg1cum/family1/667773dea9b843e18bd64e954940569a into 0eca6e73d2bd4b412cf03f0c2b29562a/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/039094b090794d708f54298da439f35e_SeqId_49_) 2023-11-21 13:55:54,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__csma8b3mivd3928l4289lt1h64tr6l2f8hp1vhj97ji3ju4b2r0pnlmdddeg1cum/family1/667773dea9b843e18bd64e954940569a 2023-11-21 13:55:54,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-21 13:55:54,713 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:54,714 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511203d439061d9b349c4bd3c77b64bc65d13 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511203d439061d9b349c4bd3c77b64bc65d13 2023-11-21 13:55:54,715 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128fb06cb6108f643b7bd1af96380d3c0bd to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128fb06cb6108f643b7bd1af96380d3c0bd 2023-11-21 13:55:54,715 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130df5957b73cf94df0b5672296a934ec5b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130df5957b73cf94df0b5672296a934ec5b 2023-11-21 13:55:54,715 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-21 13:55:54,716 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-21 13:55:54,716 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-21 13:55:54,716 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-21 13:55:54,716 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-21 13:55:54,716 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-21 13:55:54,716 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:55:54,719 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-21 13:55:54,720 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.0630 sec 2023-11-21 13:55:54,904 INFO [Listener at localhost/35077] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=264 (was 251) - Thread LEAK? -, OpenFileDescriptor=677 (was 657) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=176 (was 158) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=7337 (was 7337) 2023-11-21 13:55:54,916 INFO [Listener at localhost/35077] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=264, OpenFileDescriptor=677, MaxFileDescriptor=60000, SystemLoadAverage=176, ProcessCount=168, AvailableMemoryMB=7336 2023-11-21 13:55:54,934 DEBUG [Listener at localhost/35077] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-21 13:55:54,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10@\xFB\xC2X\x9E\xE7\x1E\xA8&\x86\xAD\xD8\xBBj=|"\x10\x85M\xEC\x9E\xE9"\xF9\xC8\xD5\xEC\xEE(\x0F\xDC$\xD1*\x10nE\xA9z\x97\xAC\xF9\x17Y"c\xFD\xD3\xADa\xD02\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-21 13:55:54,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-21 13:55:54,990 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-21 13:55:54,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-21 13:55:54,991 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-21 13:55:54,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-21 13:55:54,992 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887 2023-11-21 13:55:54,992 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66 2023-11-21 13:55:54,993 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2 2023-11-21 13:55:54,993 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887 empty. 2023-11-21 13:55:54,993 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66 empty. 2023-11-21 13:55:54,993 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2 empty. 2023-11-21 13:55:54,993 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66 2023-11-21 13:55:54,993 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887 2023-11-21 13:55:54,993 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2 2023-11-21 13:55:54,993 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-21 13:55:55,000 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-21 13:55:55,001 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 213427543ab379504b068e3e3ca633f2, NAME => 'testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10@\xFB\xC2X\x9E\xE7\x1E\xA8&\x86\xAD\xD8\xBBj=|"\x10\x85M\xEC\x9E\xE9"\xF9\xC8\xD5\xEC\xEE(\x0F\xDC$\xD1*\x10nE\xA9z\x97\xAC\xF9\x17Y"c\xFD\xD3\xADa\xD02\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:55:55,002 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 25ac761e08fb8ebb38603b7e4edbba66, NAME => 'testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10@\xFB\xC2X\x9E\xE7\x1E\xA8&\x86\xAD\xD8\xBBj=|"\x10\x85M\xEC\x9E\xE9"\xF9\xC8\xD5\xEC\xEE(\x0F\xDC$\xD1*\x10nE\xA9z\x97\xAC\xF9\x17Y"c\xFD\xD3\xADa\xD02\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:55:55,002 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0b4180ab9cf0d7f98a807f65a5c12887, NAME => 'testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10@\xFB\xC2X\x9E\xE7\x1E\xA8&\x86\xAD\xD8\xBBj=|"\x10\x85M\xEC\x9E\xE9"\xF9\xC8\xD5\xEC\xEE(\x0F\xDC$\xD1*\x10nE\xA9z\x97\xAC\xF9\x17Y"c\xFD\xD3\xADa\xD02\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/.tmp 2023-11-21 13:55:55,014 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:55,014 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 25ac761e08fb8ebb38603b7e4edbba66, disabling compactions & flushes 2023-11-21 13:55:55,014 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:55:55,014 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:55:55,014 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. after waiting 0 ms 2023-11-21 13:55:55,014 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:55:55,014 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:55:55,014 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 25ac761e08fb8ebb38603b7e4edbba66: 2023-11-21 13:55:55,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-21 13:55:55,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-21 13:55:55,414 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:55,414 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:55,414 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 0b4180ab9cf0d7f98a807f65a5c12887, disabling compactions & flushes 2023-11-21 13:55:55,414 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 213427543ab379504b068e3e3ca633f2, disabling compactions & flushes 2023-11-21 13:55:55,414 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:55:55,414 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:55:55,414 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:55:55,414 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:55:55,414 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. after waiting 0 ms 2023-11-21 13:55:55,414 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:55:55,414 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. after waiting 0 ms 2023-11-21 13:55:55,414 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:55:55,414 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:55:55,414 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:55:55,414 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 213427543ab379504b068e3e3ca633f2: 2023-11-21 13:55:55,414 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 0b4180ab9cf0d7f98a807f65a5c12887: 2023-11-21 13:55:55,416 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-21 13:55:55,417 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700574955417"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574955417"}]},"ts":"1700574955417"} 2023-11-21 13:55:55,417 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700574955417"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574955417"}]},"ts":"1700574955417"} 2023-11-21 13:55:55,417 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700574955417"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700574955417"}]},"ts":"1700574955417"} 2023-11-21 13:55:55,419 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-21 13:55:55,419 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-21 13:55:55,419 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574955419"}]},"ts":"1700574955419"} 2023-11-21 13:55:55,420 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-21 13:55:55,423 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0b4180ab9cf0d7f98a807f65a5c12887, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=25ac761e08fb8ebb38603b7e4edbba66, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=213427543ab379504b068e3e3ca633f2, ASSIGN}] 2023-11-21 13:55:55,425 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=25ac761e08fb8ebb38603b7e4edbba66, ASSIGN 2023-11-21 13:55:55,425 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0b4180ab9cf0d7f98a807f65a5c12887, ASSIGN 2023-11-21 13:55:55,425 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=213427543ab379504b068e3e3ca633f2, ASSIGN 2023-11-21 13:55:55,426 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=25ac761e08fb8ebb38603b7e4edbba66, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:55:55,426 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0b4180ab9cf0d7f98a807f65a5c12887, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:55:55,426 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=213427543ab379504b068e3e3ca633f2, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46365,1700574804408; forceNewPlan=false, retain=false 2023-11-21 13:55:55,577 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=25ac761e08fb8ebb38603b7e4edbba66, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:55,577 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=213427543ab379504b068e3e3ca633f2, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:55,577 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=0b4180ab9cf0d7f98a807f65a5c12887, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:55,578 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700574955577"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574955577"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574955577"}]},"ts":"1700574955577"} 2023-11-21 13:55:55,578 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700574955577"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574955577"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574955577"}]},"ts":"1700574955577"} 2023-11-21 13:55:55,578 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700574955577"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700574955577"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700574955577"}]},"ts":"1700574955577"} 2023-11-21 13:55:55,579 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=118, state=RUNNABLE; OpenRegionProcedure 25ac761e08fb8ebb38603b7e4edbba66, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:55,580 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure 213427543ab379504b068e3e3ca633f2, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:55,580 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure 0b4180ab9cf0d7f98a807f65a5c12887, server=jenkins-hbase6.apache.org,46365,1700574804408}] 2023-11-21 13:55:55,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-21 13:55:55,730 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:55,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:55:55,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b4180ab9cf0d7f98a807f65a5c12887, NAME => 'testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887.', STARTKEY => '', ENDKEY => '1'} 2023-11-21 13:55:55,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 0b4180ab9cf0d7f98a807f65a5c12887 2023-11-21 13:55:55,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:55,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 0b4180ab9cf0d7f98a807f65a5c12887 2023-11-21 13:55:55,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 0b4180ab9cf0d7f98a807f65a5c12887 2023-11-21 13:55:55,754 INFO [StoreOpener-0b4180ab9cf0d7f98a807f65a5c12887-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0b4180ab9cf0d7f98a807f65a5c12887 2023-11-21 13:55:55,756 DEBUG [StoreOpener-0b4180ab9cf0d7f98a807f65a5c12887-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1 2023-11-21 13:55:55,756 DEBUG [StoreOpener-0b4180ab9cf0d7f98a807f65a5c12887-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1 2023-11-21 13:55:55,756 INFO [StoreOpener-0b4180ab9cf0d7f98a807f65a5c12887-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b4180ab9cf0d7f98a807f65a5c12887 columnFamilyName family1 2023-11-21 13:55:55,757 INFO [StoreOpener-0b4180ab9cf0d7f98a807f65a5c12887-1] regionserver.HStore(310): Store=0b4180ab9cf0d7f98a807f65a5c12887/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:55,757 INFO [StoreOpener-0b4180ab9cf0d7f98a807f65a5c12887-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0b4180ab9cf0d7f98a807f65a5c12887 2023-11-21 13:55:55,759 DEBUG [StoreOpener-0b4180ab9cf0d7f98a807f65a5c12887-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2 2023-11-21 13:55:55,759 DEBUG [StoreOpener-0b4180ab9cf0d7f98a807f65a5c12887-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2 2023-11-21 13:55:55,759 INFO [StoreOpener-0b4180ab9cf0d7f98a807f65a5c12887-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b4180ab9cf0d7f98a807f65a5c12887 columnFamilyName family2 2023-11-21 13:55:55,760 INFO [StoreOpener-0b4180ab9cf0d7f98a807f65a5c12887-1] regionserver.HStore(310): Store=0b4180ab9cf0d7f98a807f65a5c12887/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:55,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887 2023-11-21 13:55:55,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887 2023-11-21 13:55:55,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-21 13:55:55,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 0b4180ab9cf0d7f98a807f65a5c12887 2023-11-21 13:55:55,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:55:55,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 0b4180ab9cf0d7f98a807f65a5c12887; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65857551, jitterRate=-0.018646016716957092}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-21 13:55:55,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 0b4180ab9cf0d7f98a807f65a5c12887: 2023-11-21 13:55:55,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887., pid=122, masterSystemTime=1700574955730 2023-11-21 13:55:55,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:55:55,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:55:55,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:55:55,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 25ac761e08fb8ebb38603b7e4edbba66, NAME => 'testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66.', STARTKEY => '1', ENDKEY => '2'} 2023-11-21 13:55:55,768 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=0b4180ab9cf0d7f98a807f65a5c12887, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:55,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 25ac761e08fb8ebb38603b7e4edbba66 2023-11-21 13:55:55,768 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700574955768"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574955768"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574955768"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574955768"}]},"ts":"1700574955768"} 2023-11-21 13:55:55,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:55,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 25ac761e08fb8ebb38603b7e4edbba66 2023-11-21 13:55:55,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 25ac761e08fb8ebb38603b7e4edbba66 2023-11-21 13:55:55,771 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=122, resume processing ppid=117 2023-11-21 13:55:55,771 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure 0b4180ab9cf0d7f98a807f65a5c12887, server=jenkins-hbase6.apache.org,46365,1700574804408 in 189 msec 2023-11-21 13:55:55,771 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0b4180ab9cf0d7f98a807f65a5c12887, ASSIGN in 348 msec 2023-11-21 13:55:55,788 INFO [StoreOpener-25ac761e08fb8ebb38603b7e4edbba66-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 25ac761e08fb8ebb38603b7e4edbba66 2023-11-21 13:55:55,790 DEBUG [StoreOpener-25ac761e08fb8ebb38603b7e4edbba66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1 2023-11-21 13:55:55,790 DEBUG [StoreOpener-25ac761e08fb8ebb38603b7e4edbba66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1 2023-11-21 13:55:55,790 INFO [StoreOpener-25ac761e08fb8ebb38603b7e4edbba66-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25ac761e08fb8ebb38603b7e4edbba66 columnFamilyName family1 2023-11-21 13:55:55,791 INFO [StoreOpener-25ac761e08fb8ebb38603b7e4edbba66-1] regionserver.HStore(310): Store=25ac761e08fb8ebb38603b7e4edbba66/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:55,791 INFO [StoreOpener-25ac761e08fb8ebb38603b7e4edbba66-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 25ac761e08fb8ebb38603b7e4edbba66 2023-11-21 13:55:55,792 DEBUG [StoreOpener-25ac761e08fb8ebb38603b7e4edbba66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2 2023-11-21 13:55:55,792 DEBUG [StoreOpener-25ac761e08fb8ebb38603b7e4edbba66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2 2023-11-21 13:55:55,792 INFO [StoreOpener-25ac761e08fb8ebb38603b7e4edbba66-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25ac761e08fb8ebb38603b7e4edbba66 columnFamilyName family2 2023-11-21 13:55:55,793 INFO [StoreOpener-25ac761e08fb8ebb38603b7e4edbba66-1] regionserver.HStore(310): Store=25ac761e08fb8ebb38603b7e4edbba66/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:55,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66 2023-11-21 13:55:55,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66 2023-11-21 13:55:55,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-21 13:55:55,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 25ac761e08fb8ebb38603b7e4edbba66 2023-11-21 13:55:55,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:55:55,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 25ac761e08fb8ebb38603b7e4edbba66; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61431090, jitterRate=-0.08460542559623718}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-21 13:55:55,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 25ac761e08fb8ebb38603b7e4edbba66: 2023-11-21 13:55:55,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66., pid=120, masterSystemTime=1700574955730 2023-11-21 13:55:55,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:55:55,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:55:55,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:55:55,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 213427543ab379504b068e3e3ca633f2, NAME => 'testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2.', STARTKEY => '2', ENDKEY => ''} 2023-11-21 13:55:55,800 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=25ac761e08fb8ebb38603b7e4edbba66, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:55,800 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700574955800"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574955800"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574955800"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574955800"}]},"ts":"1700574955800"} 2023-11-21 13:55:55,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 213427543ab379504b068e3e3ca633f2 2023-11-21 13:55:55,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-21 13:55:55,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 213427543ab379504b068e3e3ca633f2 2023-11-21 13:55:55,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 213427543ab379504b068e3e3ca633f2 2023-11-21 13:55:55,803 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=120, resume processing ppid=118 2023-11-21 13:55:55,803 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=118, state=SUCCESS; OpenRegionProcedure 25ac761e08fb8ebb38603b7e4edbba66, server=jenkins-hbase6.apache.org,46365,1700574804408 in 223 msec 2023-11-21 13:55:55,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=25ac761e08fb8ebb38603b7e4edbba66, ASSIGN in 380 msec 2023-11-21 13:55:55,820 INFO [StoreOpener-213427543ab379504b068e3e3ca633f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 213427543ab379504b068e3e3ca633f2 2023-11-21 13:55:55,822 DEBUG [StoreOpener-213427543ab379504b068e3e3ca633f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1 2023-11-21 13:55:55,822 DEBUG [StoreOpener-213427543ab379504b068e3e3ca633f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1 2023-11-21 13:55:55,822 INFO [StoreOpener-213427543ab379504b068e3e3ca633f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 213427543ab379504b068e3e3ca633f2 columnFamilyName family1 2023-11-21 13:55:55,823 INFO [StoreOpener-213427543ab379504b068e3e3ca633f2-1] regionserver.HStore(310): Store=213427543ab379504b068e3e3ca633f2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:55,823 INFO [StoreOpener-213427543ab379504b068e3e3ca633f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 213427543ab379504b068e3e3ca633f2 2023-11-21 13:55:55,824 DEBUG [StoreOpener-213427543ab379504b068e3e3ca633f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2 2023-11-21 13:55:55,824 DEBUG [StoreOpener-213427543ab379504b068e3e3ca633f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2 2023-11-21 13:55:55,824 INFO [StoreOpener-213427543ab379504b068e3e3ca633f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 213427543ab379504b068e3e3ca633f2 columnFamilyName family2 2023-11-21 13:55:55,825 INFO [StoreOpener-213427543ab379504b068e3e3ca633f2-1] regionserver.HStore(310): Store=213427543ab379504b068e3e3ca633f2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-21 13:55:55,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2 2023-11-21 13:55:55,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2 2023-11-21 13:55:55,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-21 13:55:55,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 213427543ab379504b068e3e3ca633f2 2023-11-21 13:55:55,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-21 13:55:55,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 213427543ab379504b068e3e3ca633f2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63457176, jitterRate=-0.05441439151763916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-21 13:55:55,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 213427543ab379504b068e3e3ca633f2: 2023-11-21 13:55:55,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2., pid=121, masterSystemTime=1700574955730 2023-11-21 13:55:55,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:55:55,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:55:55,832 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=213427543ab379504b068e3e3ca633f2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:55,832 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700574955832"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700574955832"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700574955832"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700574955832"}]},"ts":"1700574955832"} 2023-11-21 13:55:55,835 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=121, resume processing ppid=119 2023-11-21 13:55:55,835 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure 213427543ab379504b068e3e3ca633f2, server=jenkins-hbase6.apache.org,46365,1700574804408 in 254 msec 2023-11-21 13:55:55,836 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=119, resume processing ppid=116 2023-11-21 13:55:55,836 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=213427543ab379504b068e3e3ca633f2, ASSIGN in 412 msec 2023-11-21 13:55:55,836 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-21 13:55:55,836 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700574955836"}]},"ts":"1700574955836"} 2023-11-21 13:55:55,837 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-21 13:55:55,839 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-21 13:55:55,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 851 msec 2023-11-21 13:55:55,865 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/.tmp/family1/4e7e468871ca445eb2f2441bf32d9c70 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/4e7e468871ca445eb2f2441bf32d9c70 2023-11-21 13:55:55,869 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0eca6e73d2bd4b412cf03f0c2b29562a/family1 of 0eca6e73d2bd4b412cf03f0c2b29562a into 4e7e468871ca445eb2f2441bf32d9c70(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-21 13:55:55,869 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0eca6e73d2bd4b412cf03f0c2b29562a: 2023-11-21 13:55:55,869 INFO [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1700574954624; duration=1sec 2023-11-21 13:55:55,869 DEBUG [RS:0;jenkins-hbase6:46365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-21 13:55:55,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/23e4e623d94e40e5bc4b8bd1a65fcf86, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/769d35216db743b9b88424d5fe033faa, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/87536542688146bab290887bf3fae80f_SeqId_47_] to archive 2023-11-21 13:55:55,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:55:55,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/23e4e623d94e40e5bc4b8bd1a65fcf86 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/23e4e623d94e40e5bc4b8bd1a65fcf86 2023-11-21 13:55:55,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/769d35216db743b9b88424d5fe033faa to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/769d35216db743b9b88424d5fe033faa 2023-11-21 13:55:55,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/87536542688146bab290887bf3fae80f_SeqId_47_ to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/family1/87536542688146bab290887bf3fae80f_SeqId_47_ 2023-11-21 13:55:56,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-21 13:55:56,095 INFO [Listener at localhost/35077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-21 13:55:56,100 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:56,101 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:56,101 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:56,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:56,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-21 13:55:56,104 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-21 13:55:56,104 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:56,105 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-21 13:55:56,105 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-21 13:55:56,105 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:56,105 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:55:56,107 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:56,107 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:56,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:56,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:56,107 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:56,107 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:56,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:55:56,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:56,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:56,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:55:56,108 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-21 13:55:56,108 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-21 13:55:56,109 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-21 13:55:56,109 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:56,109 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-21 13:55:56,109 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:55:56,109 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. started... 2023-11-21 13:55:56,109 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-21 13:55:56,109 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:56,110 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:55:56,110 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b4180ab9cf0d7f98a807f65a5c12887 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-21 13:55:56,110 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:55:56,110 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. started... 2023-11-21 13:55:56,110 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. started... 2023-11-21 13:55:56,111 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 213427543ab379504b068e3e3ca633f2 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-21 13:55:56,111 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 25ac761e08fb8ebb38603b7e4edbba66 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-21 13:55:56,154 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112156411d3034b04c18a61f97b96a8c7065 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023112156411d3034b04c18a61f97b96a8c7065 2023-11-21 13:55:56,168 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family1/ada9b811f86a4395b15ca8bb59137cae 2023-11-21 13:55:56,168 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311214f10bfbf7ddd4c23bbfff75d9cbf4d00 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311214f10bfbf7ddd4c23bbfff75d9cbf4d00 2023-11-21 13:55:56,184 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family1/ab498314cd4246c69296b89b7d4213d4 2023-11-21 13:55:56,216 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311218bd5e59524be4c1983b9ff3f0994862b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311218bd5e59524be4c1983b9ff3f0994862b 2023-11-21 13:55:56,554 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231121b7efd1c1a6bc4d55a88b4f1d17c36587 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231121b7efd1c1a6bc4d55a88b4f1d17c36587 2023-11-21 13:55:56,612 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311218110005480014f06a02fb4bd1b5d67b5 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311218110005480014f06a02fb4bd1b5d67b5 2023-11-21 13:55:56,620 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family2/0ac65d8dfc564287a6fa6154ae20cc02 2023-11-21 13:55:56,623 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family1/ab498314cd4246c69296b89b7d4213d4 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/ab498314cd4246c69296b89b7d4213d4 2023-11-21 13:55:56,646 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/ab498314cd4246c69296b89b7d4213d4, entries=4, sequenceid=5, filesize=5.5 K 2023-11-21 13:55:56,646 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family2/0ac65d8dfc564287a6fa6154ae20cc02 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/0ac65d8dfc564287a6fa6154ae20cc02 2023-11-21 13:55:56,649 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/0ac65d8dfc564287a6fa6154ae20cc02, entries=2, sequenceid=5, filesize=5.1 K 2023-11-21 13:55:56,650 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 25ac761e08fb8ebb38603b7e4edbba66 in 539ms, sequenceid=5, compaction requested=false 2023-11-21 13:55:56,650 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-21 13:55:56,651 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 25ac761e08fb8ebb38603b7e4edbba66: 2023-11-21 13:55:56,651 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:55:56,651 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-21 13:55:56,969 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family1/1351e34aac95437d87d3adda81351cdf 2023-11-21 13:55:57,017 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family2/8beec8f9f01b447c8f47f9150d064a44 2023-11-21 13:55:57,020 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family1/ada9b811f86a4395b15ca8bb59137cae as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/ada9b811f86a4395b15ca8bb59137cae 2023-11-21 13:55:57,042 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/ada9b811f86a4395b15ca8bb59137cae, entries=4, sequenceid=5, filesize=5.5 K 2023-11-21 13:55:57,043 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family2/8beec8f9f01b447c8f47f9150d064a44 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/8beec8f9f01b447c8f47f9150d064a44 2023-11-21 13:55:57,046 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/8beec8f9f01b447c8f47f9150d064a44, entries=2, sequenceid=5, filesize=5.1 K 2023-11-21 13:55:57,047 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 213427543ab379504b068e3e3ca633f2 in 936ms, sequenceid=5, compaction requested=false 2023-11-21 13:55:57,048 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 213427543ab379504b068e3e3ca633f2: 2023-11-21 13:55:57,048 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:55:57,048 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-21 13:55:57,415 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311211c484a197e824becbd8e915bb23fc1a3 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311211c484a197e824becbd8e915bb23fc1a3 2023-11-21 13:55:57,820 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family2/8472a31115ec49cab5f5c21271f26639 2023-11-21 13:55:57,824 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family1/1351e34aac95437d87d3adda81351cdf as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/1351e34aac95437d87d3adda81351cdf 2023-11-21 13:55:57,849 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/1351e34aac95437d87d3adda81351cdf, entries=4, sequenceid=5, filesize=5.5 K 2023-11-21 13:55:57,849 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family2/8472a31115ec49cab5f5c21271f26639 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/8472a31115ec49cab5f5c21271f26639 2023-11-21 13:55:57,853 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/8472a31115ec49cab5f5c21271f26639, entries=2, sequenceid=5, filesize=5.1 K 2023-11-21 13:55:57,854 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0b4180ab9cf0d7f98a807f65a5c12887 in 1744ms, sequenceid=5, compaction requested=false 2023-11-21 13:55:57,854 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b4180ab9cf0d7f98a807f65a5c12887: 2023-11-21 13:55:57,854 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:55:57,854 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-21 13:55:57,854 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-21 13:55:57,854 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:57,854 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-21 13:55:57,854 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-21 13:55:57,856 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:57,856 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:55:57,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:57,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:57,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:57,856 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:55:57,856 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:57,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:57,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:57,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:55:57,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:57,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:57,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-21 13:55:57,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@aeb9454[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:57,858 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-21 13:55:57,858 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:55:57,859 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:55:57,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:55:57,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:55:57,859 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-21 13:55:57,859 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-21 13:55:57,859 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:57,859 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:57,859 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:57,861 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-21 13:55:57,861 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:57,861 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:57,861 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-21 13:55:57,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:57,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:57,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:57,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:57,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:57,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:55:57,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:57,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:57,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:55:57,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:57,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:57,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-21 13:55:57,863 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-21 13:55:57,863 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:57,863 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:57,863 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-21 13:55:57,863 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:57,873 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:57,873 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:57,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:57,873 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:57,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:57,874 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:55:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:55:57,875 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:55:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:57,877 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:57,877 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:57,877 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:55:57,877 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:55:57,877 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:57,877 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:57,877 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:57,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-21 13:55:57,877 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:55:57,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:57,877 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:55:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:57,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-21 13:55:57,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:57,878 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:57,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:57,878 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:57,878 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:57,978 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:57,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:57,980 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:57,981 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:57,981 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:57,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:57,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:57,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-21 13:55:57,985 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-21 13:55:57,985 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:57,985 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-21 13:55:57,985 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-21 13:55:57,985 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:57,985 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:55:57,986 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:57,987 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:57,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:57,987 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:57,987 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:55:57,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:55:57,988 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-21 13:55:57,988 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-21 13:55:57,988 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-21 13:55:57,988 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-21 13:55:57,988 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:57,988 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-21 13:55:57,988 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:55:57,988 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. started... 2023-11-21 13:55:57,988 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-21 13:55:57,988 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:57,988 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:55:57,988 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. started... 2023-11-21 13:55:57,988 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:55:57,988 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b4180ab9cf0d7f98a807f65a5c12887 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-21 13:55:57,989 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 25ac761e08fb8ebb38603b7e4edbba66 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-21 13:55:57,988 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. started... 2023-11-21 13:55:57,989 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 213427543ab379504b068e3e3ca633f2 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-21 13:55:58,031 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231121225e8e88f7ae480c8c28089b57b8abc6 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231121225e8e88f7ae480c8c28089b57b8abc6 2023-11-21 13:55:58,042 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311210f799aa1eb75417199e10bb1a31b0bba to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311210f799aa1eb75417199e10bb1a31b0bba 2023-11-21 13:55:58,045 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family1/5355431f9f3f47ff8e906e17449d7a08 2023-11-21 13:55:58,082 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231121e5e037c246fc4b7b95027cc60fdb9fec to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231121e5e037c246fc4b7b95027cc60fdb9fec 2023-11-21 13:55:58,086 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family2/e4dfc3ea4a1141c2891cf56b3552db08 2023-11-21 13:55:58,090 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family1/5355431f9f3f47ff8e906e17449d7a08 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/5355431f9f3f47ff8e906e17449d7a08 2023-11-21 13:55:58,112 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/5355431f9f3f47ff8e906e17449d7a08, entries=4, sequenceid=9, filesize=5.5 K 2023-11-21 13:55:58,113 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family2/e4dfc3ea4a1141c2891cf56b3552db08 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/e4dfc3ea4a1141c2891cf56b3552db08 2023-11-21 13:55:58,116 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/e4dfc3ea4a1141c2891cf56b3552db08, entries=2, sequenceid=9, filesize=5.1 K 2023-11-21 13:55:58,117 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 213427543ab379504b068e3e3ca633f2 in 128ms, sequenceid=9, compaction requested=false 2023-11-21 13:55:58,117 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 213427543ab379504b068e3e3ca633f2: 2023-11-21 13:55:58,117 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:55:58,117 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-21 13:55:58,450 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311216dc444d0cd934d2f9cc395cae2818a24 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311216dc444d0cd934d2f9cc395cae2818a24 2023-11-21 13:55:58,463 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family1/a39641c44b204b8ea4b13e5e9f618366 2023-11-21 13:55:58,864 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family1/7df7c6ce4b494fab908810e73c8aa8b7 2023-11-21 13:55:58,893 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311212d5072e3e5864bc1ad0adafe6d6c1d32 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311212d5072e3e5864bc1ad0adafe6d6c1d32 2023-11-21 13:55:58,895 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112154c3b86e78a34de3abb1596d1566ebc1 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023112154c3b86e78a34de3abb1596d1566ebc1 2023-11-21 13:55:58,900 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family2/ebcee6436683475d883c92642aa67049 2023-11-21 13:55:58,903 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family1/7df7c6ce4b494fab908810e73c8aa8b7 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/7df7c6ce4b494fab908810e73c8aa8b7 2023-11-21 13:55:58,934 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/7df7c6ce4b494fab908810e73c8aa8b7, entries=4, sequenceid=9, filesize=5.5 K 2023-11-21 13:55:58,935 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family2/ebcee6436683475d883c92642aa67049 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/ebcee6436683475d883c92642aa67049 2023-11-21 13:55:58,938 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/ebcee6436683475d883c92642aa67049, entries=2, sequenceid=9, filesize=5.1 K 2023-11-21 13:55:58,938 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0b4180ab9cf0d7f98a807f65a5c12887 in 950ms, sequenceid=9, compaction requested=false 2023-11-21 13:55:58,938 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b4180ab9cf0d7f98a807f65a5c12887: 2023-11-21 13:55:58,938 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:55:58,938 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-21 13:55:59,298 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family2/bc11600efe504d98bc89753c64d4fb28 2023-11-21 13:55:59,302 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family1/a39641c44b204b8ea4b13e5e9f618366 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/a39641c44b204b8ea4b13e5e9f618366 2023-11-21 13:55:59,324 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/a39641c44b204b8ea4b13e5e9f618366, entries=4, sequenceid=9, filesize=5.5 K 2023-11-21 13:55:59,325 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family2/bc11600efe504d98bc89753c64d4fb28 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/bc11600efe504d98bc89753c64d4fb28 2023-11-21 13:55:59,328 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/bc11600efe504d98bc89753c64d4fb28, entries=2, sequenceid=9, filesize=5.1 K 2023-11-21 13:55:59,329 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 25ac761e08fb8ebb38603b7e4edbba66 in 1341ms, sequenceid=9, compaction requested=false 2023-11-21 13:55:59,329 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 25ac761e08fb8ebb38603b7e4edbba66: 2023-11-21 13:55:59,329 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:55:59,329 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-21 13:55:59,329 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-21 13:55:59,329 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:59,329 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-21 13:55:59,329 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-21 13:55:59,331 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:59,331 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:55:59,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:59,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:59,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:59,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:59,331 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:55:59,331 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:55:59,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:59,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:55:59,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:59,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:59,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-21 13:55:59,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72d7167b[Count = 0] remaining members to acquire global barrier 2023-11-21 13:55:59,333 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-21 13:55:59,333 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:55:59,334 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:55:59,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:55:59,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:55:59,334 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-21 13:55:59,334 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-21 13:55:59,334 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:55:59,334 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:59,334 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:55:59,336 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:59,336 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-21 13:55:59,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:59,336 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:59,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:59,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:59,336 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-21 13:55:59,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:59,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:59,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:55:59,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:59,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:59,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:55:59,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:59,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:55:59,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-21 13:55:59,338 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-21 13:55:59,338 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:55:59,338 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:55:59,338 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-21 13:55:59,338 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:55:59,341 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:59,341 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:59,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:59,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:59,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:59,341 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:59,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:55:59,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:55:59,342 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:59,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:59,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:55:59,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:59,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:55:59,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:59,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:55:59,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:55:59,343 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:59,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:59,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:55:59,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:55:59,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:59,346 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:59,346 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:59,346 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:55:59,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:59,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-21 13:55:59,346 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:55:59,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:59,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-21 13:55:59,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:55:59,346 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:55:59,346 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:55:59,346 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:59,346 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:55:59,346 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:55:59,346 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:59,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:55:59,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:55:59,346 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-21 13:55:59,347 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:55:59,447 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:55:59,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:55:59,448 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:59,449 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:59,449 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:55:59,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:55:59,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-21 13:55:59,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-21 13:55:59,453 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-21 13:55:59,453 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:59,453 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-21 13:55:59,453 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-21 13:55:59,453 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:59,454 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:55:59,455 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:59,455 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:55:59,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:55:59,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:55:59,455 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:55:59,455 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:55:59,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:55:59,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:55:59,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:55:59,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:55:59,456 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-21 13:55:59,456 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-21 13:55:59,456 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-21 13:55:59,456 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-21 13:55:59,457 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:55:59,457 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-21 13:55:59,457 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:55:59,457 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. started... 2023-11-21 13:55:59,457 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b4180ab9cf0d7f98a807f65a5c12887 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-21 13:55:59,457 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:55:59,457 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. started... 2023-11-21 13:55:59,457 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-21 13:55:59,457 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:55:59,457 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. started... 2023-11-21 13:55:59,457 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:55:59,457 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 25ac761e08fb8ebb38603b7e4edbba66 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-21 13:55:59,458 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 213427543ab379504b068e3e3ca633f2 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-21 13:55:59,506 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231121ff0b86af25d246fd82dba1386d64b907 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231121ff0b86af25d246fd82dba1386d64b907 2023-11-21 13:55:59,510 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112181fab4cd443d41fda37e825c9e94bb4b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112181fab4cd443d41fda37e825c9e94bb4b 2023-11-21 13:55:59,524 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family1/bed39aa977e74411ad139fc38c0c8557 2023-11-21 13:55:59,555 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311214449233845d049c8985597fd1bc7d88a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311214449233845d049c8985597fd1bc7d88a 2023-11-21 13:55:59,559 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family2/444c5df9c9d94ca3ada9b899402fae87 2023-11-21 13:55:59,563 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family1/bed39aa977e74411ad139fc38c0c8557 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/bed39aa977e74411ad139fc38c0c8557 2023-11-21 13:55:59,586 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/bed39aa977e74411ad139fc38c0c8557, entries=4, sequenceid=13, filesize=5.5 K 2023-11-21 13:55:59,587 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family2/444c5df9c9d94ca3ada9b899402fae87 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/444c5df9c9d94ca3ada9b899402fae87 2023-11-21 13:55:59,590 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/444c5df9c9d94ca3ada9b899402fae87, entries=2, sequenceid=13, filesize=5.1 K 2023-11-21 13:55:59,591 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0b4180ab9cf0d7f98a807f65a5c12887 in 134ms, sequenceid=13, compaction requested=true 2023-11-21 13:55:59,591 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b4180ab9cf0d7f98a807f65a5c12887: 2023-11-21 13:55:59,591 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:55:59,591 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-21 13:55:59,908 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311213e2334c1015e4d038715bf6156012b8e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311213e2334c1015e4d038715bf6156012b8e 2023-11-21 13:55:59,921 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family1/cc306a0bee3d4643b69a6d54c15d3415 2023-11-21 13:55:59,923 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family1/37d203f03c504e27bee1a8f6273e12a5 2023-11-21 13:56:00,355 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311212e08b760ff864bc49f4801d71dff544c to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311212e08b760ff864bc49f4801d71dff544c 2023-11-21 13:56:00,366 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112118eab22df9554327abe9caf4317a3567 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023112118eab22df9554327abe9caf4317a3567 2023-11-21 13:56:00,369 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family2/e2861115a45e45e0856cf987d0c7d1e6 2023-11-21 13:56:00,372 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family1/37d203f03c504e27bee1a8f6273e12a5 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/37d203f03c504e27bee1a8f6273e12a5 2023-11-21 13:56:00,395 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/37d203f03c504e27bee1a8f6273e12a5, entries=4, sequenceid=13, filesize=5.5 K 2023-11-21 13:56:00,395 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family2/e2861115a45e45e0856cf987d0c7d1e6 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/e2861115a45e45e0856cf987d0c7d1e6 2023-11-21 13:56:00,399 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/e2861115a45e45e0856cf987d0c7d1e6, entries=2, sequenceid=13, filesize=5.1 K 2023-11-21 13:56:00,399 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 25ac761e08fb8ebb38603b7e4edbba66 in 942ms, sequenceid=13, compaction requested=true 2023-11-21 13:56:00,399 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 25ac761e08fb8ebb38603b7e4edbba66: 2023-11-21 13:56:00,399 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:56:00,399 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-21 13:56:00,460 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-21 13:56:00,460 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1606c065 to 127.0.0.1:52369 2023-11-21 13:56:00,460 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:56:00,461 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-21 13:56:00,461 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a079aaa to 127.0.0.1:52369 2023-11-21 13:56:00,461 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:56:00,760 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family2/f83583238a0a4455aeced50f31feb18b 2023-11-21 13:56:00,764 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family1/cc306a0bee3d4643b69a6d54c15d3415 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/cc306a0bee3d4643b69a6d54c15d3415 2023-11-21 13:56:00,787 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/cc306a0bee3d4643b69a6d54c15d3415, entries=4, sequenceid=13, filesize=5.5 K 2023-11-21 13:56:00,788 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family2/f83583238a0a4455aeced50f31feb18b as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/f83583238a0a4455aeced50f31feb18b 2023-11-21 13:56:00,791 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/f83583238a0a4455aeced50f31feb18b, entries=2, sequenceid=13, filesize=5.1 K 2023-11-21 13:56:00,792 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 213427543ab379504b068e3e3ca633f2 in 1335ms, sequenceid=13, compaction requested=true 2023-11-21 13:56:00,792 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 213427543ab379504b068e3e3ca633f2: 2023-11-21 13:56:00,792 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:56:00,792 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-21 13:56:00,792 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-21 13:56:00,792 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:00,792 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-21 13:56:00,792 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-21 13:56:00,794 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:00,794 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:56:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:56:00,794 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:00,794 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:56:00,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:56:00,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:56:00,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:56:00,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:00,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:56:00,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-21 13:56:00,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3329e5d6[Count = 0] remaining members to acquire global barrier 2023-11-21 13:56:00,796 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-21 13:56:00,796 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:00,797 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:00,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:00,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:00,797 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-21 13:56:00,797 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-21 13:56:00,797 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:56:00,797 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:00,798 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:56:00,799 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-21 13:56:00,799 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:00,799 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:56:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:00,799 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-21 13:56:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:56:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:56:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:56:00,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:56:00,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:56:00,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:00,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:56:00,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:56:00,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:00,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:56:00,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-21 13:56:00,802 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-21 13:56:00,802 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:56:00,802 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:56:00,802 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-21 13:56:00,802 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:56:00,804 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:00,804 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:00,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:00,804 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:56:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:56:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:56:00,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:56:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:56:00,805 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:56:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:56:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:56:00,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:56:00,806 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:00,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:00,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:56:00,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:56:00,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:00,808 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:00,808 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:56:00,808 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:56:00,808 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:56:00,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:56:00,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-21 13:56:00,809 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:56:00,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:56:00,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-21 13:56:00,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:56:00,809 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:56:00,809 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:00,809 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:00,809 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:00,809 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:00,809 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-21 13:56:00,809 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:56:00,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:56:00,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:56:00,909 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:56:00,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:56:00,911 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:56:00,911 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:56:00,911 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-21 13:56:00,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:56:00,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-21 13:56:00,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-21 13:56:00,915 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-21 13:56:00,915 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:56:00,915 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-21 13:56:00,915 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-21 13:56:00,916 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:00,916 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:56:00,917 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:56:00,917 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:00,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:56:00,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:56:00,917 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:00,917 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:56:00,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:56:00,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:00,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:56:00,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:56:00,918 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-21 13:56:00,918 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-21 13:56:00,918 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-21 13:56:00,919 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-21 13:56:00,919 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:56:00,919 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-21 13:56:00,919 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:56:00,919 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. started... 2023-11-21 13:56:00,919 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-21 13:56:00,919 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:56:00,919 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b4180ab9cf0d7f98a807f65a5c12887 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-21 13:56:00,919 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. started... 2023-11-21 13:56:00,919 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:56:00,919 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 213427543ab379504b068e3e3ca633f2 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-21 13:56:00,919 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:56:00,919 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. started... 2023-11-21 13:56:00,919 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 25ac761e08fb8ebb38603b7e4edbba66 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-21 13:56:00,959 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231121592a97cfdce449c79ed7e531e2ff1250 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231121592a97cfdce449c79ed7e531e2ff1250 2023-11-21 13:56:00,972 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family1/bc5cd0b3d43b438e9714ce20b5e54e61 2023-11-21 13:56:01,275 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-21 13:56:01,361 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311215a3e638b06694081aececed710fe9fc4 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311215a3e638b06694081aececed710fe9fc4 2023-11-21 13:56:01,365 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112142b0114253cd4d84887f15d923032421 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023112142b0114253cd4d84887f15d923032421 2023-11-21 13:56:01,375 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family1/0dc4e2727f4845398da11c430c255964 2023-11-21 13:56:01,402 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112145bf5a9fc1ad45a199d3303123cb8449 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023112145bf5a9fc1ad45a199d3303123cb8449 2023-11-21 13:56:01,780 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family1/a4c7f46abccf45e9856e50464ac70348 2023-11-21 13:56:01,807 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231121ef8c51fd950244658a9d3fc63ece8245 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231121ef8c51fd950244658a9d3fc63ece8245 2023-11-21 13:56:01,808 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family2/141c843f52e149ec99259559ea19baa6 2023-11-21 13:56:01,814 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family2/816670d1fe9e462e900d6c946379703e 2023-11-21 13:56:01,814 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family1/bc5cd0b3d43b438e9714ce20b5e54e61 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/bc5cd0b3d43b438e9714ce20b5e54e61 2023-11-21 13:56:01,818 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311217a4c18385efe47df978acf35d9cd1ee1 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311217a4c18385efe47df978acf35d9cd1ee1 2023-11-21 13:56:01,819 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family1/0dc4e2727f4845398da11c430c255964 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/0dc4e2727f4845398da11c430c255964 2023-11-21 13:56:01,839 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family2/cabf0bd5432d4c96af78781bfc066121 2023-11-21 13:56:01,844 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family1/a4c7f46abccf45e9856e50464ac70348 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/a4c7f46abccf45e9856e50464ac70348 2023-11-21 13:56:01,852 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/bc5cd0b3d43b438e9714ce20b5e54e61, entries=4, sequenceid=17, filesize=5.5 K 2023-11-21 13:56:01,852 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family2/141c843f52e149ec99259559ea19baa6 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/141c843f52e149ec99259559ea19baa6 2023-11-21 13:56:01,857 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/141c843f52e149ec99259559ea19baa6, entries=2, sequenceid=17, filesize=5.1 K 2023-11-21 13:56:01,857 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 25ac761e08fb8ebb38603b7e4edbba66 in 938ms, sequenceid=17, compaction requested=true 2023-11-21 13:56:01,858 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 25ac761e08fb8ebb38603b7e4edbba66: 2023-11-21 13:56:01,858 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:56:01,858 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-21 13:56:01,859 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/0dc4e2727f4845398da11c430c255964, entries=4, sequenceid=17, filesize=5.5 K 2023-11-21 13:56:01,860 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family2/816670d1fe9e462e900d6c946379703e as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/816670d1fe9e462e900d6c946379703e 2023-11-21 13:56:01,868 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/816670d1fe9e462e900d6c946379703e, entries=2, sequenceid=17, filesize=5.1 K 2023-11-21 13:56:01,869 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0b4180ab9cf0d7f98a807f65a5c12887 in 949ms, sequenceid=17, compaction requested=true 2023-11-21 13:56:01,869 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b4180ab9cf0d7f98a807f65a5c12887: 2023-11-21 13:56:01,869 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:56:01,869 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-21 13:56:01,877 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/a4c7f46abccf45e9856e50464ac70348, entries=4, sequenceid=17, filesize=5.5 K 2023-11-21 13:56:01,878 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family2/cabf0bd5432d4c96af78781bfc066121 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/cabf0bd5432d4c96af78781bfc066121 2023-11-21 13:56:01,882 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/cabf0bd5432d4c96af78781bfc066121, entries=2, sequenceid=17, filesize=5.1 K 2023-11-21 13:56:01,882 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 213427543ab379504b068e3e3ca633f2 in 963ms, sequenceid=17, compaction requested=true 2023-11-21 13:56:01,882 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 213427543ab379504b068e3e3ca633f2: 2023-11-21 13:56:01,882 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:56:01,882 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-21 13:56:01,882 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-21 13:56:01,883 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:01,883 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-21 13:56:01,883 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-21 13:56:01,884 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:01,884 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:01,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:01,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:56:01,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:56:01,885 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:01,885 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:56:01,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:56:01,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:56:01,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:56:01,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:01,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:56:01,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-21 13:56:01,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ca9cfec[Count = 0] remaining members to acquire global barrier 2023-11-21 13:56:01,886 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-21 13:56:01,886 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:01,892 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:01,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:01,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:01,892 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-21 13:56:01,892 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-21 13:56:01,892 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:56:01,892 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:01,892 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:56:01,894 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:01,894 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-21 13:56:01,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:01,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:56:01,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:56:01,894 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:56:01,894 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-21 13:56:01,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:56:01,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:56:01,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:56:01,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:01,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:56:01,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:56:01,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:01,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:56:01,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-21 13:56:01,896 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-21 13:56:01,896 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:56:01,896 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:56:01,896 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-21 13:56:01,896 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:56:01,897 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:01,897 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:01,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:56:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:56:01,897 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:56:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:01,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:56:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:56:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:56:01,898 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:56:01,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:56:01,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:56:01,899 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:01,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:01,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:56:01,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:56:01,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:01,901 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:01,901 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:56:01,901 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:56:01,901 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:56:01,902 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:56:01,902 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:56:01,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-21 13:56:01,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-21 13:56:01,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:56:01,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:56:01,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:56:01,902 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:01,902 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:01,902 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:01,902 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:01,902 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-21 13:56:01,902 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:56:01,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:56:01,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:56:02,002 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:56:02,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:56:02,011 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:56:02,017 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:56:02,024 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:56:02,025 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:56:02,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(936): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-11-21 13:56:02,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-21 13:56:02,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-21 13:56:02,109 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-21 13:56:02,109 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:56:02,110 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-21 13:56:02,110 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-21 13:56:02,110 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:02,110 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:56:02,112 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:56:02,112 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:02,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:56:02,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:56:02,113 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:02,113 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-21 13:56:02,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:56:02,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:02,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-21 13:56:02,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:56:02,114 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-21 13:56:02,114 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-21 13:56:02,114 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-21 13:56:02,114 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-21 13:56:02,114 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-21 13:56:02,114 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-21 13:56:02,114 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:56:02,114 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. started... 2023-11-21 13:56:02,114 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:56:02,114 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b4180ab9cf0d7f98a807f65a5c12887 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-21 13:56:02,114 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-21 13:56:02,114 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-21 13:56:02,114 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. started... 2023-11-21 13:56:02,115 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:56:02,115 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. started... 2023-11-21 13:56:02,115 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 25ac761e08fb8ebb38603b7e4edbba66 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-21 13:56:02,115 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 213427543ab379504b068e3e3ca633f2 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-21 13:56:02,560 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family1/6428c892b81e42be98bf72e402f89a8b 2023-11-21 13:56:02,585 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6428c892b81e42be98bf72e402f89a8b 2023-11-21 13:56:02,961 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family1/890d94f94f7d4ec28c4fa33ef6b650d2 2023-11-21 13:56:02,968 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family1/1ebb0e511bbd4e4081b69356c63151fc 2023-11-21 13:56:02,984 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 890d94f94f7d4ec28c4fa33ef6b650d2 2023-11-21 13:56:02,991 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ebb0e511bbd4e4081b69356c63151fc 2023-11-21 13:56:02,996 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family2/92020b93a44a4aaa99605b66b9225331 2023-11-21 13:56:03,000 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92020b93a44a4aaa99605b66b9225331 2023-11-21 13:56:03,001 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family1/6428c892b81e42be98bf72e402f89a8b as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/6428c892b81e42be98bf72e402f89a8b 2023-11-21 13:56:03,002 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family2/a95b2560bfdb463abd39cdd2c85e6970 2023-11-21 13:56:03,004 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a95b2560bfdb463abd39cdd2c85e6970 2023-11-21 13:56:03,005 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family1/1ebb0e511bbd4e4081b69356c63151fc as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/1ebb0e511bbd4e4081b69356c63151fc 2023-11-21 13:56:03,024 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6428c892b81e42be98bf72e402f89a8b 2023-11-21 13:56:03,025 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/6428c892b81e42be98bf72e402f89a8b, entries=3, sequenceid=23, filesize=5.2 K 2023-11-21 13:56:03,025 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family2/92020b93a44a4aaa99605b66b9225331 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/92020b93a44a4aaa99605b66b9225331 2023-11-21 13:56:03,028 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92020b93a44a4aaa99605b66b9225331 2023-11-21 13:56:03,029 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/92020b93a44a4aaa99605b66b9225331, entries=1, sequenceid=23, filesize=5.0 K 2023-11-21 13:56:03,029 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 213427543ab379504b068e3e3ca633f2 in 914ms, sequenceid=23, compaction requested=true 2023-11-21 13:56:03,029 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 213427543ab379504b068e3e3ca633f2: 2023-11-21 13:56:03,029 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:56:03,029 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-21 13:56:03,039 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ebb0e511bbd4e4081b69356c63151fc 2023-11-21 13:56:03,039 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/1ebb0e511bbd4e4081b69356c63151fc, entries=3, sequenceid=23, filesize=5.2 K 2023-11-21 13:56:03,040 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family2/a95b2560bfdb463abd39cdd2c85e6970 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/a95b2560bfdb463abd39cdd2c85e6970 2023-11-21 13:56:03,044 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a95b2560bfdb463abd39cdd2c85e6970 2023-11-21 13:56:03,044 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/a95b2560bfdb463abd39cdd2c85e6970, entries=1, sequenceid=23, filesize=5.0 K 2023-11-21 13:56:03,045 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 25ac761e08fb8ebb38603b7e4edbba66 in 930ms, sequenceid=23, compaction requested=true 2023-11-21 13:56:03,045 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 25ac761e08fb8ebb38603b7e4edbba66: 2023-11-21 13:56:03,045 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:56:03,045 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-21 13:56:03,796 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family2/77c8a38a6e14491f84c3c5e9abbd6b4b 2023-11-21 13:56:03,799 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77c8a38a6e14491f84c3c5e9abbd6b4b 2023-11-21 13:56:03,800 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family1/890d94f94f7d4ec28c4fa33ef6b650d2 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/890d94f94f7d4ec28c4fa33ef6b650d2 2023-11-21 13:56:03,824 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 890d94f94f7d4ec28c4fa33ef6b650d2 2023-11-21 13:56:03,824 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/890d94f94f7d4ec28c4fa33ef6b650d2, entries=3, sequenceid=23, filesize=5.2 K 2023-11-21 13:56:03,825 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family2/77c8a38a6e14491f84c3c5e9abbd6b4b as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/77c8a38a6e14491f84c3c5e9abbd6b4b 2023-11-21 13:56:03,828 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77c8a38a6e14491f84c3c5e9abbd6b4b 2023-11-21 13:56:03,828 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/77c8a38a6e14491f84c3c5e9abbd6b4b, entries=1, sequenceid=23, filesize=5.0 K 2023-11-21 13:56:03,829 INFO [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0b4180ab9cf0d7f98a807f65a5c12887 in 1715ms, sequenceid=23, compaction requested=true 2023-11-21 13:56:03,829 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b4180ab9cf0d7f98a807f65a5c12887: 2023-11-21 13:56:03,829 DEBUG [rs(jenkins-hbase6.apache.org,46365,1700574804408)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:56:03,829 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-21 13:56:03,829 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-21 13:56:03,829 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:03,829 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-21 13:56:03,829 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-21 13:56:03,832 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:03,832 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:03,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:03,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:56:03,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:56:03,833 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:03,833 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-21 13:56:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:56:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:56:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:56:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:03,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:56:03,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46365,1700574804408' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-21 13:56:03,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ab6b919[Count = 0] remaining members to acquire global barrier 2023-11-21 13:56:03,834 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-21 13:56:03,834 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:03,835 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:03,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:03,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:03,835 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-21 13:56:03,836 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-21 13:56:03,836 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase6.apache.org,46365,1700574804408' in zk 2023-11-21 13:56:03,836 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:03,836 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-21 13:56:03,837 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-21 13:56:03,837 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:03,837 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:56:03,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:03,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:56:03,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:56:03,837 DEBUG [member: 'jenkins-hbase6.apache.org,46365,1700574804408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-21 13:56:03,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:56:03,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:56:03,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:56:03,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:03,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:56:03,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:56:03,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:03,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase6.apache.org,46365,1700574804408': 2023-11-21 13:56:03,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46365,1700574804408' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-21 13:56:03,840 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-21 13:56:03,840 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-21 13:56:03,840 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-21 13:56:03,840 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-21 13:56:03,840 INFO [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-21 13:56:03,841 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:03,841 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:56:03,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:03,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:03,841 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:03,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:03,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-21 13:56:03,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-21 13:56:03,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:56:03,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:56:03,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:03,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-21 13:56:03,842 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:03,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:56:03,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-21 13:56:03,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:56:03,843 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:03,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:03,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-21 13:56:03,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-21 13:56:03,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:03,847 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:03,847 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:56:03,847 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-21 13:56:03,847 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-21 13:56:03,847 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-21 13:56:03,847 DEBUG [(jenkins-hbase6.apache.org,43219,1700574803183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-21 13:56:03,847 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:03,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-21 13:56:03,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-21 13:56:03,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-21 13:56:03,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-21 13:56:03,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-21 13:56:03,847 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:03,847 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-21 13:56:03,847 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-21 13:56:03,847 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-21 13:56:03,847 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-21 13:56:03,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-21 13:56:03,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-21 13:56:03,947 DEBUG [Listener at localhost/35077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-21 13:56:03,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43219] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-21 13:56:03,949 DEBUG [Listener at localhost/35077] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:56:03,949 DEBUG [Listener at localhost/35077] regionserver.HStore(1912): 0b4180ab9cf0d7f98a807f65a5c12887/family1 is initiating major compaction (all files) 2023-11-21 13:56:03,949 INFO [Listener at localhost/35077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:56:03,949 INFO [Listener at localhost/35077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:56:03,949 INFO [Listener at localhost/35077] regionserver.HRegion(2259): Starting compaction of 0b4180ab9cf0d7f98a807f65a5c12887/family1 in testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:56:03,949 INFO [Listener at localhost/35077] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/1351e34aac95437d87d3adda81351cdf, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/7df7c6ce4b494fab908810e73c8aa8b7, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/bed39aa977e74411ad139fc38c0c8557, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/0dc4e2727f4845398da11c430c255964, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/890d94f94f7d4ec28c4fa33ef6b650d2] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp, totalSize=27.1 K 2023-11-21 13:56:03,950 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 1351e34aac95437d87d3adda81351cdf, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574956100 2023-11-21 13:56:03,950 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 7df7c6ce4b494fab908810e73c8aa8b7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574957980 2023-11-21 13:56:03,951 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting bed39aa977e74411ad139fc38c0c8557, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574959448 2023-11-21 13:56:03,951 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 0dc4e2727f4845398da11c430c255964, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574960911 2023-11-21 13:56:03,951 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 890d94f94f7d4ec28c4fa33ef6b650d2, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-21 13:56:03,960 INFO [Listener at localhost/35077] throttle.PressureAwareThroughputController(145): 0b4180ab9cf0d7f98a807f65a5c12887#family1#compaction#198 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:56:04,406 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231121208a7009a8f04c848fa70ffaabf9f591_del 2023-11-21 13:56:04,406 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231121208a7009a8f04c848fa70ffaabf9f591_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231121208a7009a8f04c848fa70ffaabf9f591_del 2023-11-21 13:56:05,257 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8ee45fbcc38f4a748094ceee6e7bc1e4 2023-11-21 13:56:05,258 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family1/8ee45fbcc38f4a748094ceee6e7bc1e4 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/8ee45fbcc38f4a748094ceee6e7bc1e4 2023-11-21 13:56:05,279 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8ee45fbcc38f4a748094ceee6e7bc1e4 2023-11-21 13:56:05,280 INFO [Listener at localhost/35077] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0b4180ab9cf0d7f98a807f65a5c12887/family1 of 0b4180ab9cf0d7f98a807f65a5c12887 into 8ee45fbcc38f4a748094ceee6e7bc1e4(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-21 13:56:05,280 DEBUG [Listener at localhost/35077] regionserver.HRegion(2289): Compaction status journal for 0b4180ab9cf0d7f98a807f65a5c12887: 2023-11-21 13:56:05,280 DEBUG [Listener at localhost/35077] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:56:05,280 DEBUG [Listener at localhost/35077] regionserver.HStore(1912): 0b4180ab9cf0d7f98a807f65a5c12887/family2 is initiating major compaction (all files) 2023-11-21 13:56:05,280 INFO [Listener at localhost/35077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:56:05,280 INFO [Listener at localhost/35077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:56:05,281 INFO [Listener at localhost/35077] regionserver.HRegion(2259): Starting compaction of 0b4180ab9cf0d7f98a807f65a5c12887/family2 in testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:56:05,281 INFO [Listener at localhost/35077] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/8472a31115ec49cab5f5c21271f26639, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/ebcee6436683475d883c92642aa67049, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/444c5df9c9d94ca3ada9b899402fae87, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/816670d1fe9e462e900d6c946379703e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/77c8a38a6e14491f84c3c5e9abbd6b4b] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp, totalSize=25.4 K 2023-11-21 13:56:05,281 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 8472a31115ec49cab5f5c21271f26639, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574956100 2023-11-21 13:56:05,281 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting ebcee6436683475d883c92642aa67049, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574957980 2023-11-21 13:56:05,282 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 444c5df9c9d94ca3ada9b899402fae87, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574959448 2023-11-21 13:56:05,282 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 816670d1fe9e462e900d6c946379703e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574960911 2023-11-21 13:56:05,282 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 77c8a38a6e14491f84c3c5e9abbd6b4b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-21 13:56:05,290 INFO [Listener at localhost/35077] throttle.PressureAwareThroughputController(145): 0b4180ab9cf0d7f98a807f65a5c12887#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:56:05,296 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231121cd55a775ee244060baaa9d7e6032a8ae_del 2023-11-21 13:56:05,296 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231121cd55a775ee244060baaa9d7e6032a8ae_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231121cd55a775ee244060baaa9d7e6032a8ae_del 2023-11-21 13:56:05,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/1351e34aac95437d87d3adda81351cdf, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/7df7c6ce4b494fab908810e73c8aa8b7, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/bed39aa977e74411ad139fc38c0c8557, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/0dc4e2727f4845398da11c430c255964, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/890d94f94f7d4ec28c4fa33ef6b650d2] to archive 2023-11-21 13:56:05,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:56:05,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/1351e34aac95437d87d3adda81351cdf to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/1351e34aac95437d87d3adda81351cdf 2023-11-21 13:56:05,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/7df7c6ce4b494fab908810e73c8aa8b7 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/7df7c6ce4b494fab908810e73c8aa8b7 2023-11-21 13:56:05,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/bed39aa977e74411ad139fc38c0c8557 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/bed39aa977e74411ad139fc38c0c8557 2023-11-21 13:56:05,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/0dc4e2727f4845398da11c430c255964 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/0dc4e2727f4845398da11c430c255964 2023-11-21 13:56:05,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/890d94f94f7d4ec28c4fa33ef6b650d2 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/890d94f94f7d4ec28c4fa33ef6b650d2 2023-11-21 13:56:06,109 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 528a8601593444bd892c5c40c5ffa5a2 2023-11-21 13:56:06,110 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/.tmp/family2/528a8601593444bd892c5c40c5ffa5a2 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/528a8601593444bd892c5c40c5ffa5a2 2023-11-21 13:56:06,113 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 528a8601593444bd892c5c40c5ffa5a2 2023-11-21 13:56:06,114 INFO [Listener at localhost/35077] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0b4180ab9cf0d7f98a807f65a5c12887/family2 of 0b4180ab9cf0d7f98a807f65a5c12887 into 528a8601593444bd892c5c40c5ffa5a2(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:56:06,114 DEBUG [Listener at localhost/35077] regionserver.HRegion(2289): Compaction status journal for 0b4180ab9cf0d7f98a807f65a5c12887: 2023-11-21 13:56:06,115 DEBUG [Listener at localhost/35077] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:56:06,115 DEBUG [Listener at localhost/35077] regionserver.HStore(1912): 25ac761e08fb8ebb38603b7e4edbba66/family1 is initiating major compaction (all files) 2023-11-21 13:56:06,115 INFO [Listener at localhost/35077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:56:06,115 INFO [Listener at localhost/35077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:56:06,117 INFO [Listener at localhost/35077] regionserver.HRegion(2259): Starting compaction of 25ac761e08fb8ebb38603b7e4edbba66/family1 in testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:56:06,117 INFO [Listener at localhost/35077] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/ab498314cd4246c69296b89b7d4213d4, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/a39641c44b204b8ea4b13e5e9f618366, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/37d203f03c504e27bee1a8f6273e12a5, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/bc5cd0b3d43b438e9714ce20b5e54e61, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/1ebb0e511bbd4e4081b69356c63151fc] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp, totalSize=27.1 K 2023-11-21 13:56:06,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/8472a31115ec49cab5f5c21271f26639, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/ebcee6436683475d883c92642aa67049, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/444c5df9c9d94ca3ada9b899402fae87, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/816670d1fe9e462e900d6c946379703e, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/77c8a38a6e14491f84c3c5e9abbd6b4b] to archive 2023-11-21 13:56:06,118 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting ab498314cd4246c69296b89b7d4213d4, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574956101 2023-11-21 13:56:06,118 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting a39641c44b204b8ea4b13e5e9f618366, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574957980 2023-11-21 13:56:06,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:56:06,119 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 37d203f03c504e27bee1a8f6273e12a5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574959449 2023-11-21 13:56:06,119 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting bc5cd0b3d43b438e9714ce20b5e54e61, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574960911 2023-11-21 13:56:06,119 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 1ebb0e511bbd4e4081b69356c63151fc, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-21 13:56:06,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/8472a31115ec49cab5f5c21271f26639 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/8472a31115ec49cab5f5c21271f26639 2023-11-21 13:56:06,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/ebcee6436683475d883c92642aa67049 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/ebcee6436683475d883c92642aa67049 2023-11-21 13:56:06,122 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/444c5df9c9d94ca3ada9b899402fae87 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/444c5df9c9d94ca3ada9b899402fae87 2023-11-21 13:56:06,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/816670d1fe9e462e900d6c946379703e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/816670d1fe9e462e900d6c946379703e 2023-11-21 13:56:06,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/77c8a38a6e14491f84c3c5e9abbd6b4b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family2/77c8a38a6e14491f84c3c5e9abbd6b4b 2023-11-21 13:56:06,128 INFO [Listener at localhost/35077] throttle.PressureAwareThroughputController(145): 25ac761e08fb8ebb38603b7e4edbba66#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:56:06,170 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023112134c0dfc8c09041089f6b3d1a34f9c010_del 2023-11-21 13:56:06,171 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112134c0dfc8c09041089f6b3d1a34f9c010_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023112134c0dfc8c09041089f6b3d1a34f9c010_del 2023-11-21 13:56:06,221 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 09e115ea6abd4fea9b527a1a8591b113 2023-11-21 13:56:06,221 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family1/09e115ea6abd4fea9b527a1a8591b113 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/09e115ea6abd4fea9b527a1a8591b113 2023-11-21 13:56:06,242 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 09e115ea6abd4fea9b527a1a8591b113 2023-11-21 13:56:06,242 INFO [Listener at localhost/35077] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 25ac761e08fb8ebb38603b7e4edbba66/family1 of 25ac761e08fb8ebb38603b7e4edbba66 into 09e115ea6abd4fea9b527a1a8591b113(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-21 13:56:06,243 DEBUG [Listener at localhost/35077] regionserver.HRegion(2289): Compaction status journal for 25ac761e08fb8ebb38603b7e4edbba66: 2023-11-21 13:56:06,243 DEBUG [Listener at localhost/35077] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:56:06,243 DEBUG [Listener at localhost/35077] regionserver.HStore(1912): 25ac761e08fb8ebb38603b7e4edbba66/family2 is initiating major compaction (all files) 2023-11-21 13:56:06,243 INFO [Listener at localhost/35077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:56:06,243 INFO [Listener at localhost/35077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:56:06,243 INFO [Listener at localhost/35077] regionserver.HRegion(2259): Starting compaction of 25ac761e08fb8ebb38603b7e4edbba66/family2 in testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:56:06,243 INFO [Listener at localhost/35077] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/0ac65d8dfc564287a6fa6154ae20cc02, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/bc11600efe504d98bc89753c64d4fb28, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/e2861115a45e45e0856cf987d0c7d1e6, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/141c843f52e149ec99259559ea19baa6, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/a95b2560bfdb463abd39cdd2c85e6970] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp, totalSize=25.4 K 2023-11-21 13:56:06,243 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 0ac65d8dfc564287a6fa6154ae20cc02, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574956101 2023-11-21 13:56:06,244 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting bc11600efe504d98bc89753c64d4fb28, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574957980 2023-11-21 13:56:06,244 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting e2861115a45e45e0856cf987d0c7d1e6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574959449 2023-11-21 13:56:06,244 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 141c843f52e149ec99259559ea19baa6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574960911 2023-11-21 13:56:06,245 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting a95b2560bfdb463abd39cdd2c85e6970, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-21 13:56:06,252 INFO [Listener at localhost/35077] throttle.PressureAwareThroughputController(145): 25ac761e08fb8ebb38603b7e4edbba66#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:56:06,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/ab498314cd4246c69296b89b7d4213d4, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/a39641c44b204b8ea4b13e5e9f618366, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/37d203f03c504e27bee1a8f6273e12a5, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/bc5cd0b3d43b438e9714ce20b5e54e61, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/1ebb0e511bbd4e4081b69356c63151fc] to archive 2023-11-21 13:56:06,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:56:06,316 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/ab498314cd4246c69296b89b7d4213d4 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/ab498314cd4246c69296b89b7d4213d4 2023-11-21 13:56:06,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/a39641c44b204b8ea4b13e5e9f618366 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/a39641c44b204b8ea4b13e5e9f618366 2023-11-21 13:56:06,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/37d203f03c504e27bee1a8f6273e12a5 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/37d203f03c504e27bee1a8f6273e12a5 2023-11-21 13:56:06,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/bc5cd0b3d43b438e9714ce20b5e54e61 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/bc5cd0b3d43b438e9714ce20b5e54e61 2023-11-21 13:56:06,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/1ebb0e511bbd4e4081b69356c63151fc to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/1ebb0e511bbd4e4081b69356c63151fc 2023-11-21 13:56:06,658 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311213320c6878b3a481987211829fa4ed40d_del 2023-11-21 13:56:06,659 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311213320c6878b3a481987211829fa4ed40d_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311213320c6878b3a481987211829fa4ed40d_del 2023-11-21 13:56:07,472 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbbd7bb056704bb8b09c38a7eb01771e 2023-11-21 13:56:07,473 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/.tmp/family2/dbbd7bb056704bb8b09c38a7eb01771e as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/dbbd7bb056704bb8b09c38a7eb01771e 2023-11-21 13:56:07,476 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbbd7bb056704bb8b09c38a7eb01771e 2023-11-21 13:56:07,476 INFO [Listener at localhost/35077] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 25ac761e08fb8ebb38603b7e4edbba66/family2 of 25ac761e08fb8ebb38603b7e4edbba66 into dbbd7bb056704bb8b09c38a7eb01771e(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-21 13:56:07,477 DEBUG [Listener at localhost/35077] regionserver.HRegion(2289): Compaction status journal for 25ac761e08fb8ebb38603b7e4edbba66: 2023-11-21 13:56:07,477 DEBUG [Listener at localhost/35077] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:56:07,477 DEBUG [Listener at localhost/35077] regionserver.HStore(1912): 213427543ab379504b068e3e3ca633f2/family1 is initiating major compaction (all files) 2023-11-21 13:56:07,477 INFO [Listener at localhost/35077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:56:07,477 INFO [Listener at localhost/35077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:56:07,477 INFO [Listener at localhost/35077] regionserver.HRegion(2259): Starting compaction of 213427543ab379504b068e3e3ca633f2/family1 in testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:56:07,477 INFO [Listener at localhost/35077] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/ada9b811f86a4395b15ca8bb59137cae, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/5355431f9f3f47ff8e906e17449d7a08, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/cc306a0bee3d4643b69a6d54c15d3415, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/a4c7f46abccf45e9856e50464ac70348, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/6428c892b81e42be98bf72e402f89a8b] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp, totalSize=27.1 K 2023-11-21 13:56:07,477 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting ada9b811f86a4395b15ca8bb59137cae, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574956101 2023-11-21 13:56:07,478 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 5355431f9f3f47ff8e906e17449d7a08, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574957981 2023-11-21 13:56:07,478 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting cc306a0bee3d4643b69a6d54c15d3415, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574959449 2023-11-21 13:56:07,478 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting a4c7f46abccf45e9856e50464ac70348, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574960911 2023-11-21 13:56:07,478 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 6428c892b81e42be98bf72e402f89a8b, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-21 13:56:07,486 INFO [Listener at localhost/35077] throttle.PressureAwareThroughputController(145): 213427543ab379504b068e3e3ca633f2#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:56:07,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/0ac65d8dfc564287a6fa6154ae20cc02, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/bc11600efe504d98bc89753c64d4fb28, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/e2861115a45e45e0856cf987d0c7d1e6, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/141c843f52e149ec99259559ea19baa6, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/a95b2560bfdb463abd39cdd2c85e6970] to archive 2023-11-21 13:56:07,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:56:07,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/0ac65d8dfc564287a6fa6154ae20cc02 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/0ac65d8dfc564287a6fa6154ae20cc02 2023-11-21 13:56:07,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/bc11600efe504d98bc89753c64d4fb28 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/bc11600efe504d98bc89753c64d4fb28 2023-11-21 13:56:07,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/e2861115a45e45e0856cf987d0c7d1e6 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/e2861115a45e45e0856cf987d0c7d1e6 2023-11-21 13:56:07,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/141c843f52e149ec99259559ea19baa6 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/141c843f52e149ec99259559ea19baa6 2023-11-21 13:56:07,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/a95b2560bfdb463abd39cdd2c85e6970 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family2/a95b2560bfdb463abd39cdd2c85e6970 2023-11-21 13:56:07,922 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023112190e155973688403aa5891a1899b1371d_del 2023-11-21 13:56:07,922 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112190e155973688403aa5891a1899b1371d_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023112190e155973688403aa5891a1899b1371d_del 2023-11-21 13:56:08,774 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 946ca344dd494948a39074a85edf0f70 2023-11-21 13:56:08,775 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family1/946ca344dd494948a39074a85edf0f70 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/946ca344dd494948a39074a85edf0f70 2023-11-21 13:56:08,796 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 946ca344dd494948a39074a85edf0f70 2023-11-21 13:56:08,797 INFO [Listener at localhost/35077] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 213427543ab379504b068e3e3ca633f2/family1 of 213427543ab379504b068e3e3ca633f2 into 946ca344dd494948a39074a85edf0f70(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-21 13:56:08,797 DEBUG [Listener at localhost/35077] regionserver.HRegion(2289): Compaction status journal for 213427543ab379504b068e3e3ca633f2: 2023-11-21 13:56:08,797 DEBUG [Listener at localhost/35077] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-21 13:56:08,797 DEBUG [Listener at localhost/35077] regionserver.HStore(1912): 213427543ab379504b068e3e3ca633f2/family2 is initiating major compaction (all files) 2023-11-21 13:56:08,797 INFO [Listener at localhost/35077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-21 13:56:08,797 INFO [Listener at localhost/35077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-21 13:56:08,798 INFO [Listener at localhost/35077] regionserver.HRegion(2259): Starting compaction of 213427543ab379504b068e3e3ca633f2/family2 in testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:56:08,798 INFO [Listener at localhost/35077] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/8beec8f9f01b447c8f47f9150d064a44, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/e4dfc3ea4a1141c2891cf56b3552db08, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/f83583238a0a4455aeced50f31feb18b, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/cabf0bd5432d4c96af78781bfc066121, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/92020b93a44a4aaa99605b66b9225331] into tmpdir=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp, totalSize=25.4 K 2023-11-21 13:56:08,799 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 8beec8f9f01b447c8f47f9150d064a44, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700574956101 2023-11-21 13:56:08,799 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting e4dfc3ea4a1141c2891cf56b3552db08, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700574957981 2023-11-21 13:56:08,799 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting f83583238a0a4455aeced50f31feb18b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700574959449 2023-11-21 13:56:08,800 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting cabf0bd5432d4c96af78781bfc066121, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700574960911 2023-11-21 13:56:08,800 DEBUG [Listener at localhost/35077] compactions.Compactor(207): Compacting 92020b93a44a4aaa99605b66b9225331, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-21 13:56:08,808 INFO [Listener at localhost/35077] throttle.PressureAwareThroughputController(145): 213427543ab379504b068e3e3ca633f2#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-21 13:56:08,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/ada9b811f86a4395b15ca8bb59137cae, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/5355431f9f3f47ff8e906e17449d7a08, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/cc306a0bee3d4643b69a6d54c15d3415, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/a4c7f46abccf45e9856e50464ac70348, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/6428c892b81e42be98bf72e402f89a8b] to archive 2023-11-21 13:56:08,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:56:08,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/ada9b811f86a4395b15ca8bb59137cae to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/ada9b811f86a4395b15ca8bb59137cae 2023-11-21 13:56:08,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/5355431f9f3f47ff8e906e17449d7a08 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/5355431f9f3f47ff8e906e17449d7a08 2023-11-21 13:56:08,818 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/cc306a0bee3d4643b69a6d54c15d3415 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/cc306a0bee3d4643b69a6d54c15d3415 2023-11-21 13:56:08,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/a4c7f46abccf45e9856e50464ac70348 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/a4c7f46abccf45e9856e50464ac70348 2023-11-21 13:56:08,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/6428c892b81e42be98bf72e402f89a8b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/6428c892b81e42be98bf72e402f89a8b 2023-11-21 13:56:09,216 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231121b0a8c556dc724f03936d9d210591de53_del 2023-11-21 13:56:09,216 INFO [Listener at localhost/35077] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231121b0a8c556dc724f03936d9d210591de53_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231121b0a8c556dc724f03936d9d210591de53_del 2023-11-21 13:56:10,029 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 66d6644d65764a07bcbaeef151ed401a 2023-11-21 13:56:10,029 DEBUG [Listener at localhost/35077] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/.tmp/family2/66d6644d65764a07bcbaeef151ed401a as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/66d6644d65764a07bcbaeef151ed401a 2023-11-21 13:56:10,033 INFO [Listener at localhost/35077] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 66d6644d65764a07bcbaeef151ed401a 2023-11-21 13:56:10,034 INFO [Listener at localhost/35077] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 213427543ab379504b068e3e3ca633f2/family2 of 213427543ab379504b068e3e3ca633f2 into 66d6644d65764a07bcbaeef151ed401a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-21 13:56:10,034 DEBUG [Listener at localhost/35077] regionserver.HRegion(2289): Compaction status journal for 213427543ab379504b068e3e3ca633f2: 2023-11-21 13:56:10,037 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:56:10,040 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:56:10,043 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:56:10,043 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:56:10,048 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43219] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10@\xFB\xC2X\x9E\xE7\x1E\xA8&\x86\xAD\xD8\xBBj=|"\x10\x85M\xEC\x9E\xE9"\xF9\xC8\xD5\xEC\xEE(\x0F\xDC$\xD1*\x10nE\xA9z\x97\xAC\xF9\x17Y"c\xFD\xD3\xADa\xD02\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-21 13:56:10,069 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-21 13:56:10,070 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-21 13:56:10,071 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:56:10,071 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700575570071 2023-11-21 13:56:10,071 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-21 13:56:10,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/8beec8f9f01b447c8f47f9150d064a44, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/e4dfc3ea4a1141c2891cf56b3552db08, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/f83583238a0a4455aeced50f31feb18b, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/cabf0bd5432d4c96af78781bfc066121, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/92020b93a44a4aaa99605b66b9225331] to archive 2023-11-21 13:56:10,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:56:10,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/8beec8f9f01b447c8f47f9150d064a44 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/8beec8f9f01b447c8f47f9150d064a44 2023-11-21 13:56:10,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/e4dfc3ea4a1141c2891cf56b3552db08 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/e4dfc3ea4a1141c2891cf56b3552db08 2023-11-21 13:56:10,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/f83583238a0a4455aeced50f31feb18b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/f83583238a0a4455aeced50f31feb18b 2023-11-21 13:56:10,122 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/cabf0bd5432d4c96af78781bfc066121 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/cabf0bd5432d4c96af78781bfc066121 2023-11-21 13:56:10,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/92020b93a44a4aaa99605b66b9225331 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family2/92020b93a44a4aaa99605b66b9225331 2023-11-21 13:56:10,403 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-21 13:56:10,427 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231121208a7009a8f04c848fa70ffaabf9f591_del 2023-11-21 13:56:10,447 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023112134c0dfc8c09041089f6b3d1a34f9c010_del 2023-11-21 13:56:10,468 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023112190e155973688403aa5891a1899b1371d_del 2023-11-21 13:56:10,468 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-21 13:56:10,468 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] zookeeper.ReadOnlyZKClient(139): Connect 0x711c5e79 to 127.0.0.1:52369 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-21 13:56:10,473 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@384d9282, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-21 13:56:10,473 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231121 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-21 13:56:11,035 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231121b6dc74a50aa240b7982e38127d8ec147 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231121b6dc74a50aa240b7982e38127d8ec147 2023-11-21 13:56:11,035 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231121 table='testMajorCompactionFromAdmin' column='family1' 2023-11-21 13:56:11,046 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-21 13:56:11,049 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:53362, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-21 13:56:11,056 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-21 13:56:11,057 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-21 13:56:11,082 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231121/family1/cd23a329d4714faf9e81b8261180183a first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-21 13:56:11,083 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231121/family1/cd23a329d4714faf9e81b8261180183a}] 2023-11-21 13:56:11,088 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231121/family1/cd23a329d4714faf9e81b8261180183a for inclusion in 213427543ab379504b068e3e3ca633f2/family1 2023-11-21 13:56:11,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-21 13:56:11,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-21 13:56:11,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 213427543ab379504b068e3e3ca633f2: 2023-11-21 13:56:11,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231121/family1/cd23a329d4714faf9e81b8261180183a to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionFromAdmin__jpm81bqgltbrvbhenqv40fd6a8d3pgd15cchdbq9hf1arr8nsr415dl1kakaqtsv/family1/cd23a329d4714faf9e81b8261180183a 2023-11-21 13:56:11,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionFromAdmin__jpm81bqgltbrvbhenqv40fd6a8d3pgd15cchdbq9hf1arr8nsr415dl1kakaqtsv/family1/cd23a329d4714faf9e81b8261180183a as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/0bdc66411e794ca58afdd7c54f110b3d_SeqId_28_ 2023-11-21 13:56:11,111 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionFromAdmin__jpm81bqgltbrvbhenqv40fd6a8d3pgd15cchdbq9hf1arr8nsr415dl1kakaqtsv/family1/cd23a329d4714faf9e81b8261180183a into 213427543ab379504b068e3e3ca633f2/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/0bdc66411e794ca58afdd7c54f110b3d_SeqId_28_ - updating store file list. 2023-11-21 13:56:11,132 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/0bdc66411e794ca58afdd7c54f110b3d_SeqId_28_ into 213427543ab379504b068e3e3ca633f2/family1 2023-11-21 13:56:11,132 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionFromAdmin__jpm81bqgltbrvbhenqv40fd6a8d3pgd15cchdbq9hf1arr8nsr415dl1kakaqtsv/family1/cd23a329d4714faf9e81b8261180183a into 213427543ab379504b068e3e3ca633f2/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/family1/0bdc66411e794ca58afdd7c54f110b3d_SeqId_28_) 2023-11-21 13:56:11,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionFromAdmin__jpm81bqgltbrvbhenqv40fd6a8d3pgd15cchdbq9hf1arr8nsr415dl1kakaqtsv/family1/cd23a329d4714faf9e81b8261180183a 2023-11-21 13:56:11,134 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231121 table='testMajorCompactionFromAdmin' column='family1' 2023-11-21 13:56:11,135 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:56:11,136 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231121225e8e88f7ae480c8c28089b57b8abc6 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231121225e8e88f7ae480c8c28089b57b8abc6 2023-11-21 13:56:11,137 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023112142b0114253cd4d84887f15d923032421 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023112142b0114253cd4d84887f15d923032421 2023-11-21 13:56:11,138 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023112156411d3034b04c18a61f97b96a8c7065 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023112156411d3034b04c18a61f97b96a8c7065 2023-11-21 13:56:11,139 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231121ff0b86af25d246fd82dba1386d64b907 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231121ff0b86af25d246fd82dba1386d64b907 2023-11-21 13:56:11,139 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-21 13:56:11,139 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231121' 2023-11-21 13:56:11,139 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231121 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-21 13:56:11,139 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231121 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-21 13:56:11,687 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112129d4c63ddc6945d7ba761e0fe534fd0f to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023112129d4c63ddc6945d7ba761e0fe534fd0f 2023-11-21 13:56:11,688 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231121 table='testMajorCompactionFromAdmin' column='family1' 2023-11-21 13:56:11,738 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231121/family1/9c5bea0d38784a8cbea64a8c143e8ed6 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-21 13:56:11,739 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231121/family1/9c5bea0d38784a8cbea64a8c143e8ed6}] 2023-11-21 13:56:11,741 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231121/family1/9c5bea0d38784a8cbea64a8c143e8ed6 for inclusion in 25ac761e08fb8ebb38603b7e4edbba66/family1 2023-11-21 13:56:11,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-21 13:56:11,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-21 13:56:11,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 25ac761e08fb8ebb38603b7e4edbba66: 2023-11-21 13:56:11,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231121/family1/9c5bea0d38784a8cbea64a8c143e8ed6 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionFromAdmin__n4sqi9139qk3n2qeiofq51qmc377f2ndv8cm7tlf6tv2ljh1m35q5vc8fcce04jf/family1/9c5bea0d38784a8cbea64a8c143e8ed6 2023-11-21 13:56:11,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionFromAdmin__n4sqi9139qk3n2qeiofq51qmc377f2ndv8cm7tlf6tv2ljh1m35q5vc8fcce04jf/family1/9c5bea0d38784a8cbea64a8c143e8ed6 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/10f85433165340c398f7035e81c57a33_SeqId_28_ 2023-11-21 13:56:11,764 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionFromAdmin__n4sqi9139qk3n2qeiofq51qmc377f2ndv8cm7tlf6tv2ljh1m35q5vc8fcce04jf/family1/9c5bea0d38784a8cbea64a8c143e8ed6 into 25ac761e08fb8ebb38603b7e4edbba66/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/10f85433165340c398f7035e81c57a33_SeqId_28_ - updating store file list. 2023-11-21 13:56:11,785 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/10f85433165340c398f7035e81c57a33_SeqId_28_ into 25ac761e08fb8ebb38603b7e4edbba66/family1 2023-11-21 13:56:11,785 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionFromAdmin__n4sqi9139qk3n2qeiofq51qmc377f2ndv8cm7tlf6tv2ljh1m35q5vc8fcce04jf/family1/9c5bea0d38784a8cbea64a8c143e8ed6 into 25ac761e08fb8ebb38603b7e4edbba66/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/family1/10f85433165340c398f7035e81c57a33_SeqId_28_) 2023-11-21 13:56:11,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionFromAdmin__n4sqi9139qk3n2qeiofq51qmc377f2ndv8cm7tlf6tv2ljh1m35q5vc8fcce04jf/family1/9c5bea0d38784a8cbea64a8c143e8ed6 2023-11-21 13:56:11,787 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231121 table='testMajorCompactionFromAdmin' column='family1' 2023-11-21 13:56:11,788 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:56:11,789 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311210f799aa1eb75417199e10bb1a31b0bba to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311210f799aa1eb75417199e10bb1a31b0bba 2023-11-21 13:56:11,790 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311213e2334c1015e4d038715bf6156012b8e to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311213e2334c1015e4d038715bf6156012b8e 2023-11-21 13:56:11,791 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311214f10bfbf7ddd4c23bbfff75d9cbf4d00 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311214f10bfbf7ddd4c23bbfff75d9cbf4d00 2023-11-21 13:56:11,792 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231121592a97cfdce449c79ed7e531e2ff1250 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231121592a97cfdce449c79ed7e531e2ff1250 2023-11-21 13:56:11,792 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-21 13:56:11,792 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231121' 2023-11-21 13:56:11,793 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231121 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-21 13:56:11,793 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231121 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-21 13:56:12,334 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311213f9c15aaf5ee421187b7311f135e03fe to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311213f9c15aaf5ee421187b7311f135e03fe 2023-11-21 13:56:12,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231121 table='testMajorCompactionFromAdmin' column='family1' 2023-11-21 13:56:12,374 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231121/family1/7d7a757642a24f46bfe05ab75cd339ec first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-21 13:56:12,375 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887., hostname=jenkins-hbase6.apache.org,46365,1700574804408, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231121/family1/7d7a757642a24f46bfe05ab75cd339ec}] 2023-11-21 13:56:12,376 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(763): Validating hfile at hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231121/family1/7d7a757642a24f46bfe05ab75cd339ec for inclusion in 0b4180ab9cf0d7f98a807f65a5c12887/family1 2023-11-21 13:56:12,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-21 13:56:12,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(777): Region bounds: first= last=1 2023-11-21 13:56:12,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegion(2446): Flush status journal for 0b4180ab9cf0d7f98a807f65a5c12887: 2023-11-21 13:56:12,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231121/family1/7d7a757642a24f46bfe05ab75cd339ec to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionFromAdmin__5kl42ketuoia4s21ceabbuk7jvbcq52gpji2fkf9fdcgjp7ctksfa81aoha3pn98/family1/7d7a757642a24f46bfe05ab75cd339ec 2023-11-21 13:56:12,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionFromAdmin__5kl42ketuoia4s21ceabbuk7jvbcq52gpji2fkf9fdcgjp7ctksfa81aoha3pn98/family1/7d7a757642a24f46bfe05ab75cd339ec as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/9ac65107426f4d59a3dfb2fd3944bca0_SeqId_28_ 2023-11-21 13:56:12,401 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(849): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionFromAdmin__5kl42ketuoia4s21ceabbuk7jvbcq52gpji2fkf9fdcgjp7ctksfa81aoha3pn98/family1/7d7a757642a24f46bfe05ab75cd339ec into 0b4180ab9cf0d7f98a807f65a5c12887/family1 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/9ac65107426f4d59a3dfb2fd3944bca0_SeqId_28_ - updating store file list. 2023-11-21 13:56:12,422 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(882): Loaded HFile hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/9ac65107426f4d59a3dfb2fd3944bca0_SeqId_28_ into 0b4180ab9cf0d7f98a807f65a5c12887/family1 2023-11-21 13:56:12,422 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.HStore(855): Successfully loaded hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionFromAdmin__5kl42ketuoia4s21ceabbuk7jvbcq52gpji2fkf9fdcgjp7ctksfa81aoha3pn98/family1/7d7a757642a24f46bfe05ab75cd339ec into 0b4180ab9cf0d7f98a807f65a5c12887/family1 (new location: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/family1/9ac65107426f4d59a3dfb2fd3944bca0_SeqId_28_) 2023-11-21 13:56:12,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/staging/jenkins__testMajorCompactionFromAdmin__5kl42ketuoia4s21ceabbuk7jvbcq52gpji2fkf9fdcgjp7ctksfa81aoha3pn98/family1/7d7a757642a24f46bfe05ab75cd339ec 2023-11-21 13:56:12,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231121 table='testMajorCompactionFromAdmin' column='family1' 2023-11-21 13:56:12,425 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:56:12,426 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311215a3e638b06694081aececed710fe9fc4 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311215a3e638b06694081aececed710fe9fc4 2023-11-21 13:56:12,427 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311216dc444d0cd934d2f9cc395cae2818a24 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311216dc444d0cd934d2f9cc395cae2818a24 2023-11-21 13:56:12,428 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112181fab4cd443d41fda37e825c9e94bb4b to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112181fab4cd443d41fda37e825c9e94bb4b 2023-11-21 13:56:12,428 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231121b7efd1c1a6bc4d55a88b4f1d17c36587 to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231121b7efd1c1a6bc4d55a88b4f1d17c36587 2023-11-21 13:56:12,429 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-21 13:56:12,429 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231121' 2023-11-21 13:56:12,429 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231121 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-21 13:56:12,429 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-21 13:56:12,429 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-21 13:56:12,429 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231121208a7009a8f04c848fa70ffaabf9f591_del] 2023-11-21 13:56:12,429 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:56:12,430 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231121208a7009a8f04c848fa70ffaabf9f591_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231121208a7009a8f04c848fa70ffaabf9f591_del 2023-11-21 13:56:12,430 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-21 13:56:12,430 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023112134c0dfc8c09041089f6b3d1a34f9c010_del] 2023-11-21 13:56:12,431 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:56:12,432 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023112134c0dfc8c09041089f6b3d1a34f9c010_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023112134c0dfc8c09041089f6b3d1a34f9c010_del 2023-11-21 13:56:12,432 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-21 13:56:12,432 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023112190e155973688403aa5891a1899b1371d_del] 2023-11-21 13:56:12,432 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] backup.HFileArchiver(360): Archiving compacted files. 2023-11-21 13:56:12,433 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023112190e155973688403aa5891a1899b1371d_del to hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023112190e155973688403aa5891a1899b1371d_del 2023-11-21 13:56:12,433 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-21 13:56:12,433 INFO [master/jenkins-hbase6:0:becomeActiveMaster-MasterMobCompaction-1700574807450] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-21 13:56:12,434 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-21 13:56:12,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.3650 sec 2023-11-21 13:56:12,452 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:56:12,454 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:56:12,456 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-21 13:56:12,457 DEBUG [Listener at localhost/35077] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-21 13:56:12,461 INFO [Listener at localhost/35077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-21 13:56:12,495 INFO [Listener at localhost/35077] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=251 (was 264), OpenFileDescriptor=666 (was 677), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=159 (was 176), ProcessCount=168 (was 168), AvailableMemoryMB=7324 (was 7336) 2023-11-21 13:56:12,496 DEBUG [Listener at localhost/35077] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x247479d3 to 127.0.0.1:52369 2023-11-21 13:56:12,496 DEBUG [Listener at localhost/35077] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:56:12,496 INFO [Listener at localhost/35077] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-21 13:56:12,496 INFO [Listener at localhost/35077] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-21 13:56:12,496 DEBUG [Listener at localhost/35077] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f9c4d78 to 127.0.0.1:52369 2023-11-21 13:56:12,496 DEBUG [Listener at localhost/35077] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:56:12,497 DEBUG [Listener at localhost/35077] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-21 13:56:12,497 DEBUG [Listener at localhost/35077] util.JVMClusterUtil(257): Found active master hash=186422445, stopped=false 2023-11-21 13:56:12,497 INFO [Listener at localhost/35077] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase6.apache.org,43219,1700574803183 2023-11-21 13:56:12,500 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-21 13:56:12,500 INFO [Listener at localhost/35077] procedure2.ProcedureExecutor(628): Stopping 2023-11-21 13:56:12,500 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-21 13:56:12,500 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-21 13:56:12,500 DEBUG [Listener at localhost/35077] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11b841bd to 127.0.0.1:52369 2023-11-21 13:56:12,500 DEBUG [Listener at localhost/35077] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:56:12,500 INFO [Listener at localhost/35077] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase6.apache.org,46365,1700574804408' ***** 2023-11-21 13:56:12,501 INFO [Listener at localhost/35077] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-11-21 13:56:12,501 INFO [RS:0;jenkins-hbase6:46365] regionserver.HeapMemoryManager(220): Stopping 2023-11-21 13:56:12,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-21 13:56:12,501 INFO [RS:0;jenkins-hbase6:46365] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-21 13:56:12,501 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-21 13:56:12,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-21 13:56:12,501 INFO [RS:0;jenkins-hbase6:46365] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-21 13:56:12,501 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for 1747855f64ddd440c8691d3cb9a8c750 2023-11-21 13:56:12,502 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for be282b8f384cf5531c69d052b9de0fc1 2023-11-21 13:56:12,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 1747855f64ddd440c8691d3cb9a8c750, disabling compactions & flushes 2023-11-21 13:56:12,502 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for e005e724571afdd7b19c1242ce731aca 2023-11-21 13:56:12,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:56:12,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:56:12,502 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for a9b41c012f2bce1737bed7cb5c4c9b7e 2023-11-21 13:56:12,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. after waiting 0 ms 2023-11-21 13:56:12,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:56:12,503 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for 489c1aeed0cfc5efd1e74cd4f52c14b7 2023-11-21 13:56:12,503 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for a3726db2a6d35a4ace20911e14a84575 2023-11-21 13:56:12,503 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for 0b4180ab9cf0d7f98a807f65a5c12887 2023-11-21 13:56:12,503 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for 25ac761e08fb8ebb38603b7e4edbba66 2023-11-21 13:56:12,503 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for 42379350746f695b24783d6548efae7f 2023-11-21 13:56:12,503 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for e72e2258c53c48d805ce683abe6d24d2 2023-11-21 13:56:12,503 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for 7f56f11b9f2883e62033f7f9de924a85 2023-11-21 13:56:12,503 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for 25535f294975fa5548703e68e64b1bfc 2023-11-21 13:56:12,503 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for 37258dbac07186fa63e6eb65c44df362 2023-11-21 13:56:12,503 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for 2c2220da91c79539696a8094984e331e 2023-11-21 13:56:12,503 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for 5cb093399d723625f3078fe0d10bdf3b 2023-11-21 13:56:12,503 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for 5e019165ab563441c6490eadcc58d4e7 2023-11-21 13:56:12,503 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for 0eca6e73d2bd4b412cf03f0c2b29562a 2023-11-21 13:56:12,503 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for 0b83305f53a4485e1244393d0f9631c7 2023-11-21 13:56:12,503 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:56:12,503 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for 213427543ab379504b068e3e3ca633f2 2023-11-21 13:56:12,503 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1144): stopping server jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:12,503 DEBUG [RS:0;jenkins-hbase6:46365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33b88935 to 127.0.0.1:52369 2023-11-21 13:56:12,503 DEBUG [RS:0;jenkins-hbase6:46365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:56:12,504 INFO [RS:0;jenkins-hbase6:46365] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-21 13:56:12,504 INFO [RS:0;jenkins-hbase6:46365] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-21 13:56:12,504 INFO [RS:0;jenkins-hbase6:46365] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-21 13:56:12,504 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-11-21 13:56:12,504 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-11-21 13:56:12,504 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-21 13:56:12,504 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-21 13:56:12,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-21 13:56:12,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-21 13:56:12,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-21 13:56:12,505 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-11-21 13:56:12,505 DEBUG [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1504): Waiting on 0b4180ab9cf0d7f98a807f65a5c12887, 0b83305f53a4485e1244393d0f9631c7, 0eca6e73d2bd4b412cf03f0c2b29562a, 1588230740, 1747855f64ddd440c8691d3cb9a8c750, 213427543ab379504b068e3e3ca633f2, 25535f294975fa5548703e68e64b1bfc, 25ac761e08fb8ebb38603b7e4edbba66, 2c2220da91c79539696a8094984e331e, 37258dbac07186fa63e6eb65c44df362, 42379350746f695b24783d6548efae7f, 489c1aeed0cfc5efd1e74cd4f52c14b7, 5cb093399d723625f3078fe0d10bdf3b, 5e019165ab563441c6490eadcc58d4e7, 7f56f11b9f2883e62033f7f9de924a85, a3726db2a6d35a4ace20911e14a84575, a9b41c012f2bce1737bed7cb5c4c9b7e, be282b8f384cf5531c69d052b9de0fc1, e005e724571afdd7b19c1242ce731aca, e72e2258c53c48d805ce683abe6d24d2, fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:56:12,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithMonthlyPolicy/1747855f64ddd440c8691d3cb9a8c750/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-21 13:56:12,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:56:12,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 1747855f64ddd440c8691d3cb9a8c750: 2023-11-21 13:56:12,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1700574822323.1747855f64ddd440c8691d3cb9a8c750. 2023-11-21 13:56:12,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing be282b8f384cf5531c69d052b9de0fc1, disabling compactions & flushes 2023-11-21 13:56:12,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:56:12,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:56:12,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. after waiting 0 ms 2023-11-21 13:56:12,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:56:12,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/be282b8f384cf5531c69d052b9de0fc1/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-21 13:56:12,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:56:12,513 INFO [regionserver/jenkins-hbase6:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-21 13:56:12,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for be282b8f384cf5531c69d052b9de0fc1: 2023-11-21 13:56:12,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700574885125.be282b8f384cf5531c69d052b9de0fc1. 2023-11-21 13:56:12,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing e005e724571afdd7b19c1242ce731aca, disabling compactions & flushes 2023-11-21 13:56:12,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:56:12,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:56:12,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. after waiting 0 ms 2023-11-21 13:56:12,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:56:12,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyPolicy/e005e724571afdd7b19c1242ce731aca/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-21 13:56:12,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:56:12,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for e005e724571afdd7b19c1242ce731aca: 2023-11-21 13:56:12,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1700574855601.e005e724571afdd7b19c1242ce731aca. 2023-11-21 13:56:12,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing a9b41c012f2bce1737bed7cb5c4c9b7e, disabling compactions & flushes 2023-11-21 13:56:12,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:56:12,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:56:12,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. after waiting 0 ms 2023-11-21 13:56:12,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:56:12,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithWeeklyPolicy/a9b41c012f2bce1737bed7cb5c4c9b7e/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-21 13:56:12,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:56:12,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for a9b41c012f2bce1737bed7cb5c4c9b7e: 2023-11-21 13:56:12,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1700574836885.a9b41c012f2bce1737bed7cb5c4c9b7e. 2023-11-21 13:56:12,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 489c1aeed0cfc5efd1e74cd4f52c14b7, disabling compactions & flushes 2023-11-21 13:56:12,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:56:12,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:56:12,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. after waiting 0 ms 2023-11-21 13:56:12,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:56:12,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/489c1aeed0cfc5efd1e74cd4f52c14b7/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-21 13:56:12,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:56:12,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 489c1aeed0cfc5efd1e74cd4f52c14b7: 2023-11-21 13:56:12,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1700574904603.489c1aeed0cfc5efd1e74cd4f52c14b7. 2023-11-21 13:56:12,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing a3726db2a6d35a4ace20911e14a84575, disabling compactions & flushes 2023-11-21 13:56:12,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:56:12,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:56:12,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. after waiting 0 ms 2023-11-21 13:56:12,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:56:12,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/a3726db2a6d35a4ace20911e14a84575/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-21 13:56:12,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:56:12,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for a3726db2a6d35a4ace20911e14a84575: 2023-11-21 13:56:12,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1700574904603.a3726db2a6d35a4ace20911e14a84575. 2023-11-21 13:56:12,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 0b4180ab9cf0d7f98a807f65a5c12887, disabling compactions & flushes 2023-11-21 13:56:12,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:56:12,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:56:12,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. after waiting 0 ms 2023-11-21 13:56:12,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:56:12,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/0b4180ab9cf0d7f98a807f65a5c12887/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-21 13:56:12,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:56:12,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 0b4180ab9cf0d7f98a807f65a5c12887: 2023-11-21 13:56:12,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1700574954959.0b4180ab9cf0d7f98a807f65a5c12887. 2023-11-21 13:56:12,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 25ac761e08fb8ebb38603b7e4edbba66, disabling compactions & flushes 2023-11-21 13:56:12,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:56:12,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:56:12,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. after waiting 0 ms 2023-11-21 13:56:12,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:56:12,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/25ac761e08fb8ebb38603b7e4edbba66/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-21 13:56:12,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:56:12,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 25ac761e08fb8ebb38603b7e4edbba66: 2023-11-21 13:56:12,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1700574954959.25ac761e08fb8ebb38603b7e4edbba66. 2023-11-21 13:56:12,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 42379350746f695b24783d6548efae7f, disabling compactions & flushes 2023-11-21 13:56:12,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. 2023-11-21 13:56:12,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. 2023-11-21 13:56:12,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. after waiting 0 ms 2023-11-21 13:56:12,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. 2023-11-21 13:56:12,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/42379350746f695b24783d6548efae7f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-21 13:56:12,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. 2023-11-21 13:56:12,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 42379350746f695b24783d6548efae7f: 2023-11-21 13:56:12,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1700574850606.42379350746f695b24783d6548efae7f. 2023-11-21 13:56:12,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing e72e2258c53c48d805ce683abe6d24d2, disabling compactions & flushes 2023-11-21 13:56:12,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:56:12,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:56:12,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. after waiting 0 ms 2023-11-21 13:56:12,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:56:12,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/e72e2258c53c48d805ce683abe6d24d2/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-21 13:56:12,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:56:12,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for e72e2258c53c48d805ce683abe6d24d2: 2023-11-21 13:56:12,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1700574924854.e72e2258c53c48d805ce683abe6d24d2. 2023-11-21 13:56:12,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 7f56f11b9f2883e62033f7f9de924a85, disabling compactions & flushes 2023-11-21 13:56:12,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. 2023-11-21 13:56:12,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. 2023-11-21 13:56:12,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. after waiting 0 ms 2023-11-21 13:56:12,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. 2023-11-21 13:56:12,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/7f56f11b9f2883e62033f7f9de924a85/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-21 13:56:12,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. 2023-11-21 13:56:12,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 7f56f11b9f2883e62033f7f9de924a85: 2023-11-21 13:56:12,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1700574850606.7f56f11b9f2883e62033f7f9de924a85. 2023-11-21 13:56:12,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 25535f294975fa5548703e68e64b1bfc, disabling compactions & flushes 2023-11-21 13:56:12,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:56:12,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:56:12,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. after waiting 0 ms 2023-11-21 13:56:12,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:56:12,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/25535f294975fa5548703e68e64b1bfc/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-21 13:56:12,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:56:12,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 25535f294975fa5548703e68e64b1bfc: 2023-11-21 13:56:12,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1700574924854.25535f294975fa5548703e68e64b1bfc. 2023-11-21 13:56:12,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 37258dbac07186fa63e6eb65c44df362, disabling compactions & flushes 2023-11-21 13:56:12,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:56:12,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:56:12,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. after waiting 0 ms 2023-11-21 13:56:12,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:56:12,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/37258dbac07186fa63e6eb65c44df362/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-21 13:56:12,557 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:56:12,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 37258dbac07186fa63e6eb65c44df362: 2023-11-21 13:56:12,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700574807597.37258dbac07186fa63e6eb65c44df362. 2023-11-21 13:56:12,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 2c2220da91c79539696a8094984e331e, disabling compactions & flushes 2023-11-21 13:56:12,557 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:56:12,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:56:12,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. after waiting 0 ms 2023-11-21 13:56:12,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:56:12,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testCompactionWithHFileLink/2c2220da91c79539696a8094984e331e/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-21 13:56:12,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:56:12,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 2c2220da91c79539696a8094984e331e: 2023-11-21 13:56:12,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1700574904603.2c2220da91c79539696a8094984e331e. 2023-11-21 13:56:12,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 5cb093399d723625f3078fe0d10bdf3b, disabling compactions & flushes 2023-11-21 13:56:12,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:56:12,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:56:12,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. after waiting 0 ms 2023-11-21 13:56:12,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:56:12,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/ns/testMinorCompaction/5cb093399d723625f3078fe0d10bdf3b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-21 13:56:12,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:56:12,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 5cb093399d723625f3078fe0d10bdf3b: 2023-11-21 13:56:12,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1700574924854.5cb093399d723625f3078fe0d10bdf3b. 2023-11-21 13:56:12,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 5e019165ab563441c6490eadcc58d4e7, disabling compactions & flushes 2023-11-21 13:56:12,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. 2023-11-21 13:56:12,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. 2023-11-21 13:56:12,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. after waiting 0 ms 2023-11-21 13:56:12,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. 2023-11-21 13:56:12,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testScannerOnBulkLoadRefHFiles/5e019165ab563441c6490eadcc58d4e7/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-21 13:56:12,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. 2023-11-21 13:56:12,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 5e019165ab563441c6490eadcc58d4e7: 2023-11-21 13:56:12,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1700574850606.5e019165ab563441c6490eadcc58d4e7. 2023-11-21 13:56:12,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 0eca6e73d2bd4b412cf03f0c2b29562a, disabling compactions & flushes 2023-11-21 13:56:12,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:56:12,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:56:12,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. after waiting 0 ms 2023-11-21 13:56:12,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:56:12,567 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-21 13:56:12,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMinorCompactionWithMonthlyPolicy/0eca6e73d2bd4b412cf03f0c2b29562a/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-21 13:56:12,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:56:12,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 0eca6e73d2bd4b412cf03f0c2b29562a: 2023-11-21 13:56:12,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1700574942780.0eca6e73d2bd4b412cf03f0c2b29562a. 2023-11-21 13:56:12,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 0b83305f53a4485e1244393d0f9631c7, disabling compactions & flushes 2023-11-21 13:56:12,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7. 2023-11-21 13:56:12,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7. 2023-11-21 13:56:12,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7. after waiting 0 ms 2023-11-21 13:56:12,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7. 2023-11-21 13:56:12,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2745): Flushing 0b83305f53a4485e1244393d0f9631c7 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-21 13:56:12,695 INFO [regionserver/jenkins-hbase6:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-11-21 13:56:12,695 INFO [regionserver/jenkins-hbase6:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-11-21 13:56:12,705 DEBUG [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1504): Waiting on 0b83305f53a4485e1244393d0f9631c7, 1588230740, 213427543ab379504b068e3e3ca633f2, fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:56:12,906 DEBUG [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1504): Waiting on 0b83305f53a4485e1244393d0f9631c7, 1588230740, 213427543ab379504b068e3e3ca633f2, fb33e3664562b9c0ab00fae49dcf8a20 2023-11-21 13:56:12,916 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/.tmp/info/225d1af929744db78e0257194fedab12 2023-11-21 13:56:12,920 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 225d1af929744db78e0257194fedab12 2023-11-21 13:56:12,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/namespace/0b83305f53a4485e1244393d0f9631c7/.tmp/info/87a72feb74484fd58e9472148b2fc29e 2023-11-21 13:56:12,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/namespace/0b83305f53a4485e1244393d0f9631c7/.tmp/info/87a72feb74484fd58e9472148b2fc29e as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/namespace/0b83305f53a4485e1244393d0f9631c7/info/87a72feb74484fd58e9472148b2fc29e 2023-11-21 13:56:12,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/namespace/0b83305f53a4485e1244393d0f9631c7/info/87a72feb74484fd58e9472148b2fc29e, entries=3, sequenceid=7, filesize=4.8 K 2023-11-21 13:56:12,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 0b83305f53a4485e1244393d0f9631c7 in 415ms, sequenceid=7, compaction requested=false 2023-11-21 13:56:12,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/namespace/0b83305f53a4485e1244393d0f9631c7/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-21 13:56:12,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7. 2023-11-21 13:56:12,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 0b83305f53a4485e1244393d0f9631c7: 2023-11-21 13:56:12,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1700574806302.0b83305f53a4485e1244393d0f9631c7. 2023-11-21 13:56:12,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing fb33e3664562b9c0ab00fae49dcf8a20, disabling compactions & flushes 2023-11-21 13:56:12,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:56:12,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:56:12,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. after waiting 0 ms 2023-11-21 13:56:12,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:56:12,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fb33e3664562b9c0ab00fae49dcf8a20/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-21 13:56:12,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:56:12,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for fb33e3664562b9c0ab00fae49dcf8a20: 2023-11-21 13:56:12,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700574869274.fb33e3664562b9c0ab00fae49dcf8a20. 2023-11-21 13:56:12,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 213427543ab379504b068e3e3ca633f2, disabling compactions & flushes 2023-11-21 13:56:12,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:56:12,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:56:12,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. after waiting 0 ms 2023-11-21 13:56:12,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:56:12,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/default/testMajorCompactionFromAdmin/213427543ab379504b068e3e3ca633f2/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-21 13:56:12,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:56:12,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 213427543ab379504b068e3e3ca633f2: 2023-11-21 13:56:12,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1700574954959.213427543ab379504b068e3e3ca633f2. 2023-11-21 13:56:13,106 DEBUG [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-21 13:56:13,306 DEBUG [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-21 13:56:13,326 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/.tmp/rep_barrier/d54f07bfdceb468ab3d9d86b9a1703b3 2023-11-21 13:56:13,329 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d54f07bfdceb468ab3d9d86b9a1703b3 2023-11-21 13:56:13,506 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-11-21 13:56:13,506 DEBUG [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-11-21 13:56:13,506 DEBUG [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-21 13:56:13,707 DEBUG [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-21 13:56:13,737 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/.tmp/table/b6df3435b3664112bc63e78b77138282 2023-11-21 13:56:13,740 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6df3435b3664112bc63e78b77138282 2023-11-21 13:56:13,740 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/.tmp/info/225d1af929744db78e0257194fedab12 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/info/225d1af929744db78e0257194fedab12 2023-11-21 13:56:13,744 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 225d1af929744db78e0257194fedab12 2023-11-21 13:56:13,744 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/info/225d1af929744db78e0257194fedab12, entries=226, sequenceid=130, filesize=37.9 K 2023-11-21 13:56:13,745 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/.tmp/rep_barrier/d54f07bfdceb468ab3d9d86b9a1703b3 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/rep_barrier/d54f07bfdceb468ab3d9d86b9a1703b3 2023-11-21 13:56:13,747 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d54f07bfdceb468ab3d9d86b9a1703b3 2023-11-21 13:56:13,748 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/rep_barrier/d54f07bfdceb468ab3d9d86b9a1703b3, entries=1, sequenceid=130, filesize=5.0 K 2023-11-21 13:56:13,748 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/.tmp/table/b6df3435b3664112bc63e78b77138282 as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/table/b6df3435b3664112bc63e78b77138282 2023-11-21 13:56:13,751 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6df3435b3664112bc63e78b77138282 2023-11-21 13:56:13,751 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/table/b6df3435b3664112bc63e78b77138282, entries=27, sequenceid=130, filesize=6.6 K 2023-11-21 13:56:13,753 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1248ms, sequenceid=130, compaction requested=false 2023-11-21 13:56:13,756 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-21 13:56:13,757 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-21 13:56:13,757 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-21 13:56:13,757 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-21 13:56:13,757 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-21 13:56:13,907 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1170): stopping server jenkins-hbase6.apache.org,46365,1700574804408; all regions closed. 2023-11-21 13:56:13,914 DEBUG [RS:0;jenkins-hbase6:46365] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/oldWALs 2023-11-21 13:56:13,914 INFO [RS:0;jenkins-hbase6:46365] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C46365%2C1700574804408.meta:.meta(num 1700574806029) 2023-11-21 13:56:13,918 DEBUG [RS:0;jenkins-hbase6:46365] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/oldWALs 2023-11-21 13:56:13,918 INFO [RS:0;jenkins-hbase6:46365] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C46365%2C1700574804408:(num 1700574805854) 2023-11-21 13:56:13,918 DEBUG [RS:0;jenkins-hbase6:46365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:56:13,918 INFO [RS:0;jenkins-hbase6:46365] regionserver.LeaseManager(133): Closed leases 2023-11-21 13:56:13,919 INFO [RS:0;jenkins-hbase6:46365] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-21 13:56:13,919 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-21 13:56:13,920 INFO [RS:0;jenkins-hbase6:46365] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:46365 2023-11-21 13:56:13,927 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,46365,1700574804408 2023-11-21 13:56:13,927 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-21 13:56:13,927 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-21 13:56:13,928 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,46365,1700574804408] 2023-11-21 13:56:13,928 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,46365,1700574804408; numProcessing=1 2023-11-21 13:56:13,929 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,46365,1700574804408 already deleted, retry=false 2023-11-21 13:56:13,929 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase6.apache.org,46365,1700574804408 expired; onlineServers=0 2023-11-21 13:56:13,929 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase6.apache.org,43219,1700574803183' ***** 2023-11-21 13:56:13,929 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-21 13:56:13,930 DEBUG [M:0;jenkins-hbase6:43219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a219e96, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-11-21 13:56:13,930 INFO [M:0;jenkins-hbase6:43219] regionserver.HRegionServer(1144): stopping server jenkins-hbase6.apache.org,43219,1700574803183 2023-11-21 13:56:13,930 INFO [M:0;jenkins-hbase6:43219] regionserver.HRegionServer(1170): stopping server jenkins-hbase6.apache.org,43219,1700574803183; all regions closed. 2023-11-21 13:56:13,930 DEBUG [M:0;jenkins-hbase6:43219] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-21 13:56:13,930 DEBUG [M:0;jenkins-hbase6:43219] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-21 13:56:13,930 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-21 13:56:13,930 DEBUG [M:0;jenkins-hbase6:43219] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-21 13:56:13,930 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1700574805537] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1700574805537,5,FailOnTimeoutGroup] 2023-11-21 13:56:13,930 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1700574805537] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1700574805537,5,FailOnTimeoutGroup] 2023-11-21 13:56:13,930 INFO [M:0;jenkins-hbase6:43219] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-21 13:56:13,930 INFO [M:0;jenkins-hbase6:43219] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-21 13:56:13,931 INFO [M:0;jenkins-hbase6:43219] hbase.ChoreService(369): Chore service for: master/jenkins-hbase6:0 had [] on shutdown 2023-11-21 13:56:13,931 DEBUG [M:0;jenkins-hbase6:43219] master.HMaster(1512): Stopping service threads 2023-11-21 13:56:13,931 INFO [M:0;jenkins-hbase6:43219] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-21 13:56:13,931 ERROR [M:0;jenkins-hbase6:43219] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-21 13:56:13,932 INFO [M:0;jenkins-hbase6:43219] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-21 13:56:13,932 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-21 13:56:13,932 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-21 13:56:13,932 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-21 13:56:13,932 DEBUG [M:0;jenkins-hbase6:43219] zookeeper.ZKUtil(398): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-21 13:56:13,932 WARN [M:0;jenkins-hbase6:43219] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-21 13:56:13,932 INFO [M:0;jenkins-hbase6:43219] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-21 13:56:13,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-21 13:56:13,933 INFO [M:0;jenkins-hbase6:43219] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-21 13:56:13,933 DEBUG [M:0;jenkins-hbase6:43219] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-21 13:56:13,933 INFO [M:0;jenkins-hbase6:43219] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-21 13:56:13,933 DEBUG [M:0;jenkins-hbase6:43219] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-21 13:56:13,933 DEBUG [M:0;jenkins-hbase6:43219] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-21 13:56:13,933 DEBUG [M:0;jenkins-hbase6:43219] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-21 13:56:13,933 INFO [M:0;jenkins-hbase6:43219] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.80 KB heapSize=598.56 KB 2023-11-21 13:56:13,941 INFO [M:0;jenkins-hbase6:43219] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.80 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3131e903d9e9462f97ee413cf729175a 2023-11-21 13:56:13,944 INFO [M:0;jenkins-hbase6:43219] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3131e903d9e9462f97ee413cf729175a 2023-11-21 13:56:13,945 DEBUG [M:0;jenkins-hbase6:43219] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3131e903d9e9462f97ee413cf729175a as hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3131e903d9e9462f97ee413cf729175a 2023-11-21 13:56:13,948 INFO [M:0;jenkins-hbase6:43219] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3131e903d9e9462f97ee413cf729175a 2023-11-21 13:56:13,948 INFO [M:0;jenkins-hbase6:43219] regionserver.HStore(1080): Added hdfs://localhost:40667/user/jenkins/test-data/4b3a1031-b125-4719-c373-de649bd893d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3131e903d9e9462f97ee413cf729175a, entries=123, sequenceid=1006, filesize=33.3 K 2023-11-21 13:56:13,949 INFO [M:0;jenkins-hbase6:43219] regionserver.HRegion(2948): Finished flush of dataSize ~512.80 KB/525110, heapSize ~598.55 KB/612912, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=1006, compaction requested=false 2023-11-21 13:56:13,949 INFO [M:0;jenkins-hbase6:43219] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-21 13:56:13,949 DEBUG [M:0;jenkins-hbase6:43219] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-21 13:56:13,952 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-21 13:56:13,952 INFO [M:0;jenkins-hbase6:43219] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-21 13:56:13,953 INFO [M:0;jenkins-hbase6:43219] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:43219 2023-11-21 13:56:13,955 DEBUG [M:0;jenkins-hbase6:43219] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase6.apache.org,43219,1700574803183 already deleted, retry=false 2023-11-21 13:56:14,029 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-21 13:56:14,029 INFO [RS:0;jenkins-hbase6:46365] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase6.apache.org,46365,1700574804408; zookeeper connection closed. 2023-11-21 13:56:14,029 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x101309c3dab0001, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-21 13:56:14,029 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@23c76e6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@23c76e6 2023-11-21 13:56:14,029 INFO [Listener at localhost/35077] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-21 13:56:14,056 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-21 13:56:14,056 INFO [M:0;jenkins-hbase6:43219] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase6.apache.org,43219,1700574803183; zookeeper connection closed. 2023-11-21 13:56:14,057 DEBUG [Listener at localhost/35077-EventThread] zookeeper.ZKWatcher(600): master:43219-0x101309c3dab0000, quorum=127.0.0.1:52369, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-21 13:56:14,058 WARN [Listener at localhost/35077] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-21 13:56:14,062 INFO [Listener at localhost/35077] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-21 13:56:14,170 WARN [BP-1622902389-172.31.2.20-1700574799715 heartbeating to localhost/127.0.0.1:40667] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-21 13:56:14,170 WARN [BP-1622902389-172.31.2.20-1700574799715 heartbeating to localhost/127.0.0.1:40667] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1622902389-172.31.2.20-1700574799715 (Datanode Uuid b16c3264-e603-4ce1-936d-0d9ee4193789) service to localhost/127.0.0.1:40667 2023-11-21 13:56:14,173 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/cluster_95986160-9be6-b7e5-6f91-17727d35080f/dfs/data/data1/current/BP-1622902389-172.31.2.20-1700574799715] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-21 13:56:14,173 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa40ae75-8fd8-14bf-5fa2-611f132fd2f2/cluster_95986160-9be6-b7e5-6f91-17727d35080f/dfs/data/data2/current/BP-1622902389-172.31.2.20-1700574799715] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-21 13:56:14,197 INFO [Listener at localhost/35077] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-21 13:56:14,333 INFO [Listener at localhost/35077] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-21 13:56:14,417 INFO [Listener at localhost/35077] hbase.HBaseTestingUtility(1293): Minicluster is down